Bonum Certa Men Certa

IPFS: The Good, the Bad, and the Exceptionally Ugly

Video download link | md5sum 43c1ae14359c4ba2d4adc78cc9e4601a



Summary: A personal and occasionally arduous experience with a whole year of IPFS; it may come across -- on the surface at least -- as an unconstructive rant, but IPFS is still a promising technology, albeit it has severe limitations that need to be properly understood (some can be technically overcome, too)

THE Web is generally not decentralised. The Internet is not decentralised, either. DNS is centralised, certificates are centralised (if you rely on the concept of 'trusted' CAs), and with most services you rely on just one address to work (for things to become accessible; it's possible to have multiple servers assigned/connected to the same address, but that's redundancy, not decentralisation).



Peer-to-peer (P2P) technologies and BitTorrent are OK, but they too have their limitations, including privacy- and censorship-related limitations. There are single points of failure.

IPFS is a bit different. We started using it about a year ago, starting with daily bulletins and then adding IRC logs, both in the form of HTML and plain text (the latter was added months later).

"We started using it about a year ago, starting with daily bulletins and then adding IRC logs, both in the form of HTML and plain text (the latter was added months later)."IPFS is generally good; when it works, it sure works well (albeit not quickly, the latency is incredibly high, ranging from seconds to minutes, which is unsuitable for some use cases). As I noted in the video above, this week has been more eventful than usual because the IPFS daemon started respawning endlessly and was still malfunctioning. Last night it just completely stopped working all of a sudden. With DHT traffic taking up the lion's share of the pie (unless you serve something such as video), IPFS does not scale well. It's very costly, requiring a lot of energy and bandwidth for relatively small returns. To make matters worse, it occasionally can and would become inaccessible, it can use up all the bandwidth (requiring further configuration), and it's difficult to debug. So adopting IPFS for site-related delivery of content can become a lot of work devoted to maintenance, not to mention CPU cycles and bandwidth. We have a few thousands of objects in it and it's stretching it to the limits, at least for a device with a residential connection. Several other people have reported similar issues, so we know we're not alone. What's ugly is that many of those reports -- like much of the code -- are still hosted by proprietary software (Microsoft GitHub) and are "GitHub Issues", i.e. vendor lock-in. That sends across a negative message; GitHub is an enemy of decentralisation, it's proprietary, and it is a den of arbitrary censorship on behalf of Hollywood, governments, etc.

IPFS can very quickly become utterly wasteful, just like Bitcoin and other digital (or crypto) 'coins'. But unlike coin mining, timeliness matters. IPFS can become completely inaccessible for long periods of time, with no fallbacks in place. That means downtime. We've been spending hours on IPFS this past week and it's not even serving the content (it times out); it is failing for long periods of time. It's almost impossible to debug because it is decentralised and diagnosing a swarm is incredibly difficult, akin to guesswork or "hocus pocus". One time it works, the next time it might not...

"IPFS can very quickly become utterly wasteful, just like Bitcoin and other digital (or crypto) 'coins'."As noted at the end of this video, adding a new object scales poorly (but linearly, not quadratically/exponentially) as the index of objects needs to be rebuilt from scratch (in the Go implementation at least), which means that when the number of objects doubles it can take twice as long to add new ones. If this carries on for a few years it can take an hour if not hours just to add our daily objects. Hours of CPU cycles! Maybe future/present versions tackle this issue already, so we can be patient and hope IPFS will mature/evolve gracefully. Otherwise, it is untenable for the purposes/work we've assigned to it originally (last October).

The video isn't an admission of mistake or regret; I don't personally regret pouring so much energy into IPFS, I just hope to express my thoughts on things that can be improved and probably should be improved. IPFS isn't a very young project (it has been around for quite a while), but its releases are considered not stable and work in progress. If we're part of a large experiment and the risk we take is occasional downtime (over IPFS, not Gemini or HTTP), then so be it.

Recent Techrights' Posts

Gemini Links 09/03/2025: Lagrange 1.18.5 and Writing Mannerisms
Links for the day
Links 08/03/2025: International Women's Day, Software Patents Being Squashed
Links for the day
Hiding Problems Doesn't Work
transparent organisations will be more stable and sustainable
Under the Pen Name "John O'Donnell" (LLM Slop, Not Real Article or Author) LinuxLinks Pushes Spammy Page
it happened some hours ago.
No, We Don't Want to Go "Viral" (and You Probably Don't, Either)
"Viral" junk gets forgotten quickly
 
EPO Staff Appraisals Apparently Benefit Kakistocracy, Including Cheaters Who Grant Illegal Patents and Punish Good Patent Examiners (Who Find Valid Reasons for Denials)
In prior reports the staff representatives said that rewards typically went to people who granted many patents, i.e. didn't do proper examination and instead just allowed many fake patents get enshrined as EPs, causing fiasco (from which some patent attorneys could profit)
As The Web Gets Drowned Out, Sinking in a Pool of LLM Slop, Real News Sites With Real News Become Increasingly Rare If Not Extinct
This is a real problem
Links 09/03/2025: Moderna Patents Thrown Out, Climate United Sues E.P.A.
Links for the day
Links 09/03/2025: FiveThirtyEight Killed by Disney, Nature (Journal) Chooses Suicide by Slop
Links for the day
The Harder They Try to Censor, the Bigger the Scandal (and the Impact) Will Be
We don't plan to self-censor our coverage; sometimes we just delay publication a little
Gemini Links 09/03/2025: Leasehold Derangement Syndrome, Raspberry Pi, and More
Links for the day
All-Time Low for Microsoft in Africa
it helps show how irrelevant Microsoft is becoming
French woman (frontaliere) trafficked to promote unauthorised cross border Swiss insurance
Reprinted with permission from Daniel Pocock
New York Times & Guardian reporting on Modern Slavery Act prosecution of Glodi Wabelua
Reprinted with permission from Daniel Pocock
Diana & Adrian von Bidder-Senn, EVP, Palm Sunday & Debian death on wedding day
Reprinted with permission from Daniel Pocock
The RTO (Return-to-office) Layoffs or 'Soft' Layoffs at IBM and Red Hat
There are certainly many layoffs going on there, but many are described as "resignations" or "retirements" after RTO or some other form of relocation
Over at Tux Machines...
GNU/Linux news for the past day
IRC Proceedings: Saturday, March 08, 2025
IRC logs for Saturday, March 08, 2025
Graveyard of Mastodons: A Vast Number of Inactive Accounts
More than 80% of users in mastodon.social (the "big one") are no longer active
Gemini Links 08/03/2025: Reading Cory Doctorow's 'Little Brother', Abandoning GAFAM Forever
Links for the day
Windows is Being Eradicated
On the Web, in Africa in particular, user strings or UAs that say "Windows" are becoming more rare
For International Women's Rights Day (Today) Staff Representatives at the European Patent Office (EPO) Opened Up on Gender Discrimination at the Office
Office discrimination against women is widely known; unless you sleep with men in management
Links 08/03/2025: Tariff Self Harm and Mostly Solved Diseases Making a Comeback
Links for the day
Links 08/03/2025: Climate Change Causing Food Shortages, Selling Off Chrome Still in the Cards
Links for the day
Gemini Links 08/03/2025: Driving in Japan, GrapheneOS, Tariffs Silver Lining
Links for the day
Working Like a Pack of Hyenas, the Microsofters Try Hard to Hide the Truth and Actively Censor Critics
They even target women
The Fall of the Open Source Initiative (OSI): Bylaws of the OSI a Shocking Oversight
That's what the OSI is right now: a salesperson
Thinking About Abandoning 'Google News' Altogether Due to Easy Poisoning by LLM Slop
As long as Google News keeps sending traffic to these leeches, it'll be very hard to justify relying on Google News for anything at all
Links 08/03/2025: Microsoft Failures, Further Attacks on Speech in Hong Kong
Links for the day
Gemini Links 08/03/2025: Physical Albums, Analog Computing, Deleting All Social Control Media
Links for the day
Over at Tux Machines...
GNU/Linux news for the past day
IRC Proceedings: Friday, March 07, 2025
IRC logs for Friday, March 07, 2025
OpenAI, Deep in Debt With Growing Losses, Sees Web Traffic Falling Fourfold in a Year
Microsoft's shares have fallen over 10% since the last report and OpenAI is trying to con people via Wall Street, offloading the debt to some gullible fools
Microsoft's Social Control Media Efforts Cratering (GitHub and LinkedIn)
Expect more layoffs
Microsoft Office is a Dying Cash Cow and Now It's Just Dying/Starving
Most people use Android and they don't need some bloated office suite because many processes involve Web forms
Links 07/03/2025: Radio’s Death Knells and US Abandoning Ukraine
Links for the day
Gemini Links 07/03/2025: Replacing Firefox with LibreWolf, Visiting Churches
Links for the day
Links 07/03/2025: Oracle Layoffs, HPE Eliminates 3,000 Jobs, Massive Price Hikes at Microsoft, More Surveillance in Microsoft's Stuff
Links for the day
Manslaughter: Haverfordwest convictions, Abraham Raji & Debian DebConf drowning
Reprinted with permission from Daniel Pocock
Open Source Initiative's (OSI) Latest IRS Files: Only 2.9% (2.90046827447%) of Its Income is From Members
So almost all the money is corporate
Open Source Initiative (OSI) Reported to the California Privacy Protection Agency (Formal Complaint)
Time will tell if a Cheeto-controlled California will take this seriously or just brush it aside like a head of state from Ukraine
Half a Decade Without Social Control Media
Not all audience is desirable
IBM Laid Off Almost 2,000 Staff Last Friday and No Western Publication (Newspaper, Web Site) Even Mentioned That
Only some Asian sites mentioned it
Under IBM, After Killing OpenSource.com, the Next Casualty May be "Community Blog" of the Fedora Project
It sounds like they already made the decision/s
Social Control Media as a Rapid Race to the Bottom - Part IV - Physical Health, Mental Health, and Debilitating Anxiety
One is better off feeding stray pigeons (rather than scrolling and clicking on "timelines" like a dumb pigeon)
Links 07/03/2025: WSL Breakage (as Usual), Abandoning WordPress for Hugo
Links for the day
LLM Slop Versus Richard Stallman
"Compilation Of Corruption: Jeffrey Epstein And The Halls Of Academia"
Over at Tux Machines...
GNU/Linux news for the past day
IRC Proceedings: Thursday, March 06, 2025
IRC logs for Thursday, March 06, 2025