Bonum Certa Men Certa

The Great LLM Delusion - Part I: How Microsoft is Looking to Distract From Profound Erosion of Real Value (Not Pump-and-Dump)

posted by Roy Schestowitz on Jan 29, 2024,
updated Jan 29, 2024

The Intelligence Illusion

Today we start a new series. Over the coming few days we'll highlight views and some pseudo-'news' about LLMs, which are marketed as "AI" rather than just chatbots which aren't even that good and lack commercial value in most areas they're being marketed for.

Microsoft's quarterly festival of fake 'results' is only a day away. People whom I spoke to over the telephone tell me Microsoft will probably fixate on "HEY HI" (AI) hype to mostly distract from how badly almost every division has been doing, continuing a downward trend (rapid decline). What is this "HEY HI" thing anyway? Just about anything they wish to label or relabel as "HEY HI", just like they did with servers and "clown computing". Faking "growth" by nymshifting is a form of commercial cannibalism.

This week's series will thus coincide with a sea of puff pieces about "HEY HI". Recommended readings on this kind of hype include this recent (last month) article about "HEY HI" being a bubble, based purely on hype.

But heck, what do I know about it anyway? It's not like I'm a coder or something, right? It's not like I spent over 20 years doing machine learning, right? Actually, I did.

As a student and as a postdoc I worked a lot with what the media now calls "AI", going back to 2002 when I made computer games with OpenGL and needed to work on some "logic", e.g. in my undergraduate project. So I think I have a good grasp of this area. My Ph.D. thesis (which I started writing in 2005, i.e. 19 years ago) covers the mathematics behind machine learning as applied to analysis of brain images, acquired typically by MRI.

Later work I did included more hands-on applications with OpenCV, Android, and Octave.

I can agree wholeheartedly with the text contributed to us by another person who understands the subject matter and doesn't just "name-drop" the term, in effect parroting narratives from the mainstream media, sponsored primarily though advertisers, i.e. Microsoft, Google and so on. The contributor's words will form future parts of this week's series.

Regarding the whole "illusion" (we shall use the word delusion in this series), Baldur Bjarnason did a whole book about it and, quoting his outline: "Most of the hype is bullshit. AI is already full of grifters, cons, and snake oil salesmen, and it’s only going to get worse."

This past weekend was the first time I heard of this book, but so many con artists infested the media with "AI" hype. So the summary seems like a fresh breath of air.

In December I overheard two men in the tram talking about "AI", so the media clearly controls people's offline vocabulary and that alone is rather troubling. By changing language they can change perceptions and conversations. Suddenly servers become "the cloud" and security breaches are painted as just "fucking Russians". Breaches are now "attacks". We try not to cover the buzzwords too often as it mostly magnifies the 'hype cycle' and the newspeak.

In the next part, scheduled for tomorrow, I shall explain my own understanding and interpretation of LLMs as a concept. Sentence generators are something I've studied for about 20 years, not counting rudimentary things like tokenisation, which I dealt with as a programmer 23 years ago. The next part, "What Are LLMs Anyway?", won't use very technical language. Alex Oliva, who is a programmer, followed Richard Stallman's take on this matter two months later with a metaphor ("Stochastic Parrots"). We have heard of other metaphors such as "plausible sentence generators" and LLMs being a unconventional "digital pagpag". "The more I read about 'pagpag' the more the metaphor makes sense for LLMs," one person told us after the analogy had been floated last week.

Other Recent Techrights' Posts

A Response to Bill Maher's Senseless Attacks on Julian Assange and Wikileaks
published a few hours ago
The List of Sites or Sources for Linux News is Getting Shorter Over Time (Despite GNU and Linux Steadily Growing in Usage)
A lack of publishing begets lack of educated, informed population (a return to Dark Ages where rulers leverage mass ignorance)
IRC Proceedings: Saturday, July 13, 2024
IRC logs for Saturday, July 13, 2024
Julian Assange’s Brother Gabriel Shipton Explains the Logistics of 'Smuggling' Julian Out of the United Kingdom
a lot of new information and prison stories
[Video] Why Wikileaks Publishing War-Related Documents Was Both Important and Justified
It's important to remember the principle which says privacy is for the powerless, whereas the powerful (like those with the power to kill) deserve not privacy but transparency
[Meme] Attacking the "G" in GNOME (Since 2009) Was a Mistake
Spending 50,000 pounds to sue women of racial minority
GNOME Foundation Welcomes Dolly
It didn't work out with Molly and Holly
Links 14/07/2024: Perils for AI PC Hype Train, Further Attacks on Freedom of the Press
Links for the day
The Number of Web Servers Has Gone Down
Cloud fatigue deux?
[Meme] GNOME Foundation's Relationship With Women
Lots more coming soon, so stay tuned
The Smugness of "I'm a Journalist"
Attacking women for expressing their opinions (for example, about the abuse they received) isn't unprecedented
It Takes No Courage to Become Another Corporate Stooge
transition to spam
Why Techrights Has Just Programmatically Blacklisted ZDNet
Even their "Linux" writers are AWOL
Gemini Links 14/07/2024: The Stress of 24/7 Notifications and FOSS tools for Sipeed Tang Nano 1K
Links for the day
Windows Already Down to 10% in Lao (It was 96% a Decade and a Half Ago), Vista 11 Adoption Has Stalled
And GNU/Linux is topping a 1-year high in Loa
Over at Tux Machines...
GNU/Linux news for the past day
Links 13/07/2024: Patent Trolls in UK Court of Appeal, Eric Schmidt Continues so Show Womanising at Google
Links for the day
Links 13/07/2024: Not Quite Dead Yet After All and Unfederated E-mail
Links for the day
Holly Million, GNOME Foundation departure after Albanian whistleblower revelations
Reprinted with permission from Daniel Pocock
[Meme] Like They Got Rid of Molly (and Now Holly)
Pay over 100,000 dollars a year for someone without any background in tech (to "lead" a tech project)
Microsoft Windows Falls to Almost 10% in Palestine (It Was Measured at 100% Just 15 Years Ago)
quite a big drop
Guardianship of the Licence is Not Enough (the Case of Systemd and Microsoft)
Whether the GPL gets enforced or not, if people adopt lousy software, that will have negative consequences
Speaking Out and Spreading the Message of GNU
Free Software Foundation (FSF) got 112 new members since 2.5 weeks ago
3.5 Years in Gemini
It's important to speak about and spread the word (about software freedom, BSD, GNU/Linux, patents etc.) in a medium that's strategic and growing
[Meme] Whoever in GNOME Decided to Attack the G (GNU), It Was a Foolish Miscalculation
How could they expect any outcome other than GNOME's own collapse?
Windows Down to Unprecedented Low in Czech Republic, Android Rises to New Record
From 98% in July 2009 (15 years ago) Windows is down to all-time low of 38% and well below Android
GNOME Foundation Lost Nearly a Million Dollars in 2 Years, IBM and GAFAM Won't Bail It Out Anymore
Seems like a suicide mission
Google News Has Become a Big Pile of Garbage
The issue predates chatbots, but these SEO tricks were accelerated somewhat by slop
OpenAI and ChatGPT Could Very Well Collapse and Shut Down Later This Year (Huge Losses, Sagging Usage Levels, and Massive Debt)
we illuminate the suppressed observations that Microsoft-sponsored publishers and cheaply-made slop (LLM spew disguised as "news") try to distract from
Difficult Times in GNOME Foundation
GNOME Foundation is in "crisis management" or "face-saving" or "damage control" mode
Links 13/07/2024: TikTok Interferences, YouTube Throttled in Russia
Links for the day
Kathy Lette on Julian Assange Staying at Her Attic, Why His Release Matters So Much, and Jen Robinson Staying Over Yesterday
They talk a lot about politics, but the segment mentions publishers, including Rushdie
Over at Tux Machines...
GNU/Linux news for the past day
IRC Proceedings: Friday, July 12, 2024
IRC logs for Friday, July 12, 2024
Microsoft Windows Down to a New Low in Canada (Only a Third)
Very steep decline a decade ago
Links 12/07/2024: EU/China Tensions and Ukraine War Updates
Links for the day
EPO Staff Reps: "Until now, Mr Campinos is still leaving the appellants in the dark about the exact content of the opinion of the Appeals Committee on the EPO salary adjustment procedure."
Campinos chooses to lawyer up rather than listen up
EPO Staff Representatives Say It Has Gotten Very Hard to Get Promoted (Forget About Getting Rewarded for Hard Work)
This has long been a problem
[Meme] That Time EPO Workers Were Panicking Because the Elevators Kept Getting Stuck
Many people forgot that
Occupational Health, Safety and Ergonomics Committee (LOHSEC) at the European Patent Office (EPO)
nobody in EPO management ever gets punished for crimes, no matter how severe
[Video] Julian Assange's Brother Gabriel Shipton on How the Convoy to the Airport Was Arranged, Being at the Beach With Julian Assange After Release (He's Doing Well), and How Taylor Swift Has 'Helped' Julian
At the airport he was greeted by many press crews, but they were not there for him. They were there because of Taylor Swift.
[Meme] Financial Disinformation From Chatbots Controlled by the Manipulator (Rigger)
ChatGPT, the media is starting to say you're all hype...
Microsoft is Actually Quite Worthless, Its Valuation is Based on Lies and Consistently Defrauding Shareholders
Microsoft's future is not what Wall Street "tells" us
Links 12/07/2024: Nations That Already Ban TikTok and Russia's 'Shadow War' Online
Links for the day
Gemini Links 12/07/2024: Changing and the WIPO Lunacy
Links for the day
Let's Encrypt Continues to Collapse in Geminispace and That's Good News for Free Speech (Among Other Things)
due to the way modern Web browsers work, many sites have no option but to use Let's Encrypt or pay for some other CA to issue some worthless-but-glorified bytes
Microsoft Falls Below 20% in Montenegro - Plunging to All-Time Low
sharp drop
[Meme] The Free Speech Absolutist From Apartheid South Africa
What will it take for all sensible people to quit X/Twitter?
The Final Demise of Social Control Media May be Upon Us (It Ought to be Collectively Abandoned for Society's Sake)
If it keeps going down, prospects of a turnaround or rebound are slim
Linux is Displacing Microsoft and Replacing Windows in Germany (Android Surge and New Highs for ChromeOS+GNU/Linux in Germany)
Germany is upgrading to GNU/Linux, not to latest Windows
The Latest NDAA Amendment Can (or Should) Allow the United States to Remove Microsoft Even Faster From Its Infrastructure (Which Routinely Gets Cracked Completely by Russia and China, Thanks to Microsoft)
It's time to move!
Reorganising for Better Efficiency and More Publication (Original Material)
XBox "journalism" these days is mostly slop (chatbot spew disguised as news), so studying this matter isn't easy
Software Freedom is Still the FSF
At the moment the best advocacy group for Software Freedom is the FSF
Links 12/07/2024: XBox in Trouble, Crackdowns in UAE
Links for the day
Gemini Links 12/07/2024: Make Tea Not War, Considering Guix
Links for the day
Over at Tux Machines...
GNU/Linux news for the past day
IRC Proceedings: Thursday, July 11, 2024
IRC logs for Thursday, July 11, 2024