Bonum Certa Men Certa

IPFS: The Good, the Bad, and the Exceptionally Ugly

Video download link | md5sum 43c1ae14359c4ba2d4adc78cc9e4601a



Summary: A personal and occasionally arduous experience with a whole year of IPFS; it may come across -- on the surface at least -- as an unconstructive rant, but IPFS is still a promising technology, albeit it has severe limitations that need to be properly understood (some can be technically overcome, too)

THE Web is generally not decentralised. The Internet is not decentralised, either. DNS is centralised, certificates are centralised (if you rely on the concept of 'trusted' CAs), and with most services you rely on just one address to work (for things to become accessible; it's possible to have multiple servers assigned/connected to the same address, but that's redundancy, not decentralisation).



Peer-to-peer (P2P) technologies and BitTorrent are OK, but they too have their limitations, including privacy- and censorship-related limitations. There are single points of failure.

IPFS is a bit different. We started using it about a year ago, starting with daily bulletins and then adding IRC logs, both in the form of HTML and plain text (the latter was added months later).

"We started using it about a year ago, starting with daily bulletins and then adding IRC logs, both in the form of HTML and plain text (the latter was added months later)."IPFS is generally good; when it works, it sure works well (albeit not quickly, the latency is incredibly high, ranging from seconds to minutes, which is unsuitable for some use cases). As I noted in the video above, this week has been more eventful than usual because the IPFS daemon started respawning endlessly and was still malfunctioning. Last night it just completely stopped working all of a sudden. With DHT traffic taking up the lion's share of the pie (unless you serve something such as video), IPFS does not scale well. It's very costly, requiring a lot of energy and bandwidth for relatively small returns. To make matters worse, it occasionally can and would become inaccessible, it can use up all the bandwidth (requiring further configuration), and it's difficult to debug. So adopting IPFS for site-related delivery of content can become a lot of work devoted to maintenance, not to mention CPU cycles and bandwidth. We have a few thousands of objects in it and it's stretching it to the limits, at least for a device with a residential connection. Several other people have reported similar issues, so we know we're not alone. What's ugly is that many of those reports -- like much of the code -- are still hosted by proprietary software (Microsoft GitHub) and are "GitHub Issues", i.e. vendor lock-in. That sends across a negative message; GitHub is an enemy of decentralisation, it's proprietary, and it is a den of arbitrary censorship on behalf of Hollywood, governments, etc.

IPFS can very quickly become utterly wasteful, just like Bitcoin and other digital (or crypto) 'coins'. But unlike coin mining, timeliness matters. IPFS can become completely inaccessible for long periods of time, with no fallbacks in place. That means downtime. We've been spending hours on IPFS this past week and it's not even serving the content (it times out); it is failing for long periods of time. It's almost impossible to debug because it is decentralised and diagnosing a swarm is incredibly difficult, akin to guesswork or "hocus pocus". One time it works, the next time it might not...

"IPFS can very quickly become utterly wasteful, just like Bitcoin and other digital (or crypto) 'coins'."As noted at the end of this video, adding a new object scales poorly (but linearly, not quadratically/exponentially) as the index of objects needs to be rebuilt from scratch (in the Go implementation at least), which means that when the number of objects doubles it can take twice as long to add new ones. If this carries on for a few years it can take an hour if not hours just to add our daily objects. Hours of CPU cycles! Maybe future/present versions tackle this issue already, so we can be patient and hope IPFS will mature/evolve gracefully. Otherwise, it is untenable for the purposes/work we've assigned to it originally (last October).

The video isn't an admission of mistake or regret; I don't personally regret pouring so much energy into IPFS, I just hope to express my thoughts on things that can be improved and probably should be improved. IPFS isn't a very young project (it has been around for quite a while), but its releases are considered not stable and work in progress. If we're part of a large experiment and the risk we take is occasional downtime (over IPFS, not Gemini or HTTP), then so be it.

Recent Techrights' Posts

GitHub the Company Has, in Effect, Just Died (Time to Look for Alternatives)
To Microsoft, what's left of GitHub after dismantling/folding it is some "training set" (people's code, without permission to "train" i.e. misuse under the guise of "GenAI" plagiarism)
Linux Foundation Says "Housekeeping", "Hung", "Normal", "Native Feature/Support" and "Girl/Girls" Are Offensive Words
Bombing people is OK, just use the right "terms"
It Looks More Like Microsoft GitHub Layoffs
GitHub is just losing loads of money
 
Slopfarms Slopping Away at "Linux" and Spreading Microsoft Misinformation
Slopfarms don't comprehend this as they lack actual comprehension, they're just parrots
Links 12/08/2025: Science, Hardware, and Ukraine Excluded From Negotiations About Its Future
Links for the day
Gemini Links 12/08/2025: Meditation, OpenStreetMap, Smolweb, and More
Links for the day
Google News is Dying: Most of Its Top Stories Now Are LLM Slop With Slop Images (i.e. 100% Fake 'Content')
Google News has been drowning in this sort of stuff for quite some time
Over at Tux Machines...
GNU/Linux news for the past day
IRC Proceedings: Monday, August 11, 2025
IRC logs for Monday, August 11, 2025
Our Predictions Were Right: GitHub Dying as Losses Pile Up (as a Company It Cannot Continue to Exist, It's Not 'Free Hosting')
GitHub always lost money
Links 11/08/2025: Meritless Twitter Suspensions and Disney Scraps Deepfake Dwayne Johnson
Links for the day
Gemini Links 11/08/2025: Upgrading Debian Bookworm and Better Quality PDFs From Gemini Pages
Links for the day
Currys PCWorld Lied a Decade Ago, 10 Years Later It Still Effectively Voids Your Warranty for Installing GNU/Linux Despite It Being Increasingly Mainstream
Microsoft gatekeepers
Team GNOME Has Libeled Me for Nearly 20 Years
we are not dealing with sane people
Experience With Airlines in 'Web Sites' and in 'Apps'
In a lot of ways, Stallman Was Right about what JavaScript would turn out to be
Open Does Not Mean Free
wiser to ask if some program is freedom-respecting
The Register MS Takes Money From Companies Banned by the Biden and Trump Administrations (National Security Risk)
today's sponsor
Sabotaging GNU/Linux PCs (and Users) is Not a 'Joke'
maybe cruelty is the very objective
How We Process Screenshots of Slop to Suitably Tag Them as Slop
everything is a single command
Links 11/08/2025: Data Breaches, Politics, and Climate
Links for the day
Over at Tux Machines...
GNU/Linux news for the past day
IRC Proceedings: Sunday, August 10, 2025
IRC logs for Sunday, August 10, 2025
Gemini Links 11/08/2025: Tea Caffeine Hot and Super ZZ Zero
Links for the day
Slopwatch: LinuxSecurity, Brian Fagioli, and Other Serial Sloppers
Maybe Microsoft wants to dub this "Web5"
Gemini Links 10/08/2025: Residents Management Company, Automation, and Politics
Links for the day
Links 10/08/2025: AOL Ending Dial-up
Links for the day
Seductive Mirage or Allure of Complex, Proprietary Coffee Machines (or Similar White Elephants)
Software is a lot like those things
Links 10/08/2025: Webrings, “AI Sunglasses” and “AI Eyeglasses”, US Administration Intensifies Attacks on Science and Research
Links for the day
Sometimes Newer is Worse
We generally need to reject this dumb notion that "old" means bad
The Code Used to Make Techrights Fits on a Seventh of a Floppy Disk (or 100KB When Compressed)
For the sake of comparison I've just downloaded the latest version of WordPress. The ZIP file is 27.2MB in size, or ~27,200KB.
What They Tell Young Programmers
Coding in 2025
Simpler is Better When Simple is Enough
Over-complicating things to "sell" new versions is so 1990s
Links 10/08/2025: From Social Control Media to Prison, New Examples of Windows TCO
Links for the day
Sloppy Reporting About Slop, or How The Register MS Lowers Its Standards
Maybe the management isn't even aware of this
IBM's Strategy: Cull 'Expensive' Workers, Replace Them With Cheaper Ones
So far we saw not even one rebuttal or challenge to the claim of Red Hat layoffs scheduled for tomorrow
If You Attack Somebody Too Much You Legitimise and Strengthen That Somebody
at the end those attacks add up to a "martyr" status
The Man Who Helped Microsoft Kill Linux is Trying to Delay Our Lawsuits Against Him
By conservative estimates, and based on court documents submitted by them, they're prepared to spend over a million dollars on lawyers, fighting against me and my wife
Gemini Links 10/08/2025: Gen Con 2025 and Framework Laptop
Links for the day
Over at Tux Machines...
GNU/Linux news for the past day
IRC Proceedings: Saturday, August 09, 2025
IRC logs for Saturday, August 09, 2025