Bonum Certa Men Certa

Permutation in LLMs Does, Inevitably, Change Meanings and Therefore LLMs Cannot Properly Rephrase or Summarise Texts

posted by Roy Schestowitz on Jun 23, 2025

LLMs lack actual grasp or comprehension of what they spew out

Modo hoc fallacy

We recently examined what plagiarism programs do to text, code, images etc. They don't really offer anything of value, they just replicate other people's work whilst attempting to pass that off as "fair use" and lowering the quality of the aggregated material.

"Tragedy of the commons and fallacy of composition" come to mind here.

"In your recent Techright's article titled "LLMs Breaking Everything"," a reader said, "you mention the "tragedy of the commons." There is a related concept known as the "fallacy of composition." It is quite easy to understand. You should take a look at the Wikipedia page."

To quote Wikipedia: "The fallacy of composition is an informal fallacy that arises when one infers that something is true of the whole from the fact that it is true of some part of the whole. A trivial example might be: "This tire is made of rubber; therefore, the vehicle of which it is a part is also made of rubber." That is fallacious, because vehicles are made with a variety of parts, most of which are not made of rubber. The fallacy of composition can apply even when a fact is true of every proper part of a greater entity, though. A more complicated example might be: "No atoms are alive. Therefore, nothing made of atoms is alive." This is a statement most people would consider incorrect, due to emergence, where the whole possesses properties not present in any of the parts. The fallacy of composition is related to the fallacy of hasty generalization, in which an unwarranted inference is made from a statement about a sample to a statement about the population from which the sample is drawn. The fallacy of composition is the converse of the fallacy of division."

Therein lies a problem for LLMs. Picking or cherry-picking many facts out there on the Web (assuming it's not an LLM training on its own flawed output) and throwing them in the "blender" won't guarantee that the "juice" will taste good.

There's yet another problem and analogy here.

The reader added: "I also notice that the tragedy of the commons can be caused by bloated web-pages. Each author or blogger uses sophisticated web-authoring tools which implant elements that are barely necessary."

"Another, quite obvious example is security vulnerabilities caused by OS monoculture. There is economy in using the standard computer software. Mody everybody buys PCs with, say, MS Windows installed. Crackers exploit the bugs of the ubiquitous Windows machines and cause widespread theft or erasure of data, outages, etc."

"There are several notable examples of the tragedy of the commons in the field of digital communications alone."

The bottom line is, there are tasks which cannot be automated without actual intelligence and intellect. Parsing words and throwing them as mere tokens into LLMs isn't the same as inference. A recent much-publicised paper from Apple argued that LLMs have severe limitations. Apple is a company based mostly on hype, but the LLM hype didn't attract Apple because, unlike Microsoft, it still sells actual things. It doesn't need to sell an empty promise. That's why Apple, unlike Microsoft, didn't have like 8-10 waves of mass layoffs in 2025.

Trying to rephrase/rebrand "plagiarism" as "AI" and "bad coding" (throwing together sloppy things) as "vibe coding" is dishonest marketing [1, 2]. That's all it is.

Other Recent Techrights' Posts

Amazon Web Services (AWS) Has Layoffs and Microsoft Gaming/Entertainment Division Has an Uncertain Future
it's good to see all those horrible things crashing and burning
 
Diplomatic Immunity Should Not Exist for Anybody
The EPO in its current form gradually 'normalises' the end of European democracy
Brett Wilson LLP Stopped Sending Me Papers When I Showed It had Sent Me Over 5 Kilograms of Legal Papers
A week ago we lodged our third lawsuit
Microsoft Mass Layoffs and Shutdowns Became the New Normal at Microsoft
Microsoft mass layoffs became a topic of everyday media coverage since May
Over at Tux Machines...
GNU/Linux news for the past day
IRC Proceedings: Monday, July 21, 2025
IRC logs for Monday, July 21, 2025
FSF "Raised Almost $139,000 During This Summer Campaign"
"Thank you for making a stand against dystopia!"
Gemini Links 22/07/2025: VPS Exploited and Fear of View
Links for the day
LLM Bots vs Techrights
Slows things down a bit
New Publication Sheds Lights on Abuse of Workers at the European Patent Office (EPO)
Put in simple terms, they're killing the Office, harming remaining staff, try to hire rubber-stampers
Links 21/07/2025: Hardware, Health, and Imperialism
Links for the day
Gemini Links 21/07/2025: "When Buying Isn't Owning" and "CMS Special Edition"
Links for the day
Links 21/07/2025: Indie Web and Toxic Politics
Links for the day
[Meme] Microsoft Lawyers Throwing Stones in Glass Houses
threatened me with bankruptcy
Google "AI Overview" is Not AI and Not Overview
do not be misled; what Google does isn't smart, it's just ripping off the sites it already crawled for as long as 27 years
Making the Case to Dump Microsoft and GAFAM for National and Digital Sovereignty
"Sovereignty is difficult"
The Tactics of the Opposition (Microsoft Lunduke): Associate With K00ks, Throw in Vaccines to Muddy the Water
Who stands to gain from this?
Europe's Second-Largest Institution (EPO) and Largest Patent Monopoly Office Needs More Transparency, Not Less Transparency
In the EPO, what good are elections when one candidate literally bribes all the voters?
How Not to Report News About Microsoft
This pattern of misreporting is so widespread that it's hard to believe it's not intentional
Computer Science is Under Attack, They Want Everyone to be a Consumer
If people can no longer acquire Computer Science education and real Computer Science experience, they will not know how to control their own digital destiny or emancipate the very same universities that now control the syllabus and instead of teaching Computer Science encourage the outsourcing of systems
The Best Tools Are the Simplest Tools
There's a hidden message here about the merits of sticking with X
Ofcom Online Safety Group Speaks of Protecting Women Online, Will Brett Wilson LLP Ever Listen?
They've essentially became like the Taliban's "burka police"
Social Control Media Relies on Advertisers, So It'll Always Be Hostile Towards Free Software
Sales, sales, sales
Over at Tux Machines...
GNU/Linux news for the past day
IRC Proceedings: Sunday, July 20, 2025
IRC logs for Sunday, July 20, 2025
Fragmentation of Data
Life is too short to "hoard" data
In Defence of "Spinning Rust"
Just because something is "old" (or older) doesn't mean it ought to become extinct
Using Free Software to Prepare Legal Documents
LibreOffice is openly complaining about OOXML as an obstacle
Tech and Technology Are Not the Same Anymore
"Are you into tech, Sir?"
Our Articles About SLAPPs Receive Recognition and Interest
This week we shall continue writing about the 3 lawsuits we filed
Are You Served?
For many people, advocacy of Free software and GPL enforcement are assumed to be happening
Conspiracy or grooming? Alex Jurado, Voice of Reason compared to Outreachy
Reprinted with permission from Daniel Pocock
Links 20/07/2025: Security Breaches and Former 'Open' 'AI' Engineer on Hype and Culture Issues
Links for the day
Links 20/07/2025: Fending Off BRICS and US Government Attacks Its Own Media (Like China and Russia)
Links for the day
Framed by social control media: Alex Belfield, Voice of Reason
Reprinted with permission from Daniel Pocock
Gemini Links 20/07/2025: Summertime and OCC25 Wrap-up
Links for the day
Jamie Zawinski Complained About Wayland, Then Decided to Give It a Go, Now Complains Again About Wayland
Ask IBM (Red Hat) why it's worth throwing so much away just for Wayland fanaticism
Slopwatch: Planet Ubuntu, LinuxSecurity, and More
former "Linux" blogs which basically became slopfarms
Russia Set to Ban Facebook?
If WhatsApp is made to "leave", that means Facebook or "Meta".
Links 20/07/2025: More GAFAM Lawsuits, Layoffs, and SLAPPs
Links for the day
Taking Stock of a Good and Productive Week
We shall now be taking a break, unpacking the new hard drive (8 TB), and making backups of everything
Nice Recovery (From Actual Fire) by PCLinuxOS, New Version of PCLinuxOS Released, Now Top of DistoWatch
PCLinuxOS is a community-driven distro
More Microsoft Shutdowns That Mostly Slipped Under the Radar
Remember what happened to books 'sold' by Microsoft?
Microsoft Lunduke Still Fighting Cancel Culture With... Cancel Culture
There will be no "winners" in such 'debates'
The History of Daily Links and Politics
"I support Wayland, but I also support abortion..."
Ageism in Tech
Your protocol is "old"...
Microsoft is at 0% "Market Share" in Most Areas
Depending on the taxonomy chosen, there may be dozens of categories other than desktops and laptops
"The moment MSFT stock fails to start tumbling, that’s the beginning of another corporate giant going under."
There are far more layoffs at Microsoft than at Intel, but you would not get this impression based on Wall Street media
Over at Tux Machines...
GNU/Linux news for the past day
IRC Proceedings: Saturday, July 19, 2025
IRC logs for Saturday, July 19, 2025