Bonum Certa Men Certa

IPFS: The Good, the Bad, and the Exceptionally Ugly

Video download link | md5sum 43c1ae14359c4ba2d4adc78cc9e4601a



Summary: A personal and occasionally arduous experience with a whole year of IPFS; it may come across -- on the surface at least -- as an unconstructive rant, but IPFS is still a promising technology, albeit it has severe limitations that need to be properly understood (some can be technically overcome, too)

THE Web is generally not decentralised. The Internet is not decentralised, either. DNS is centralised, certificates are centralised (if you rely on the concept of 'trusted' CAs), and with most services you rely on just one address to work (for things to become accessible; it's possible to have multiple servers assigned/connected to the same address, but that's redundancy, not decentralisation).



Peer-to-peer (P2P) technologies and BitTorrent are OK, but they too have their limitations, including privacy- and censorship-related limitations. There are single points of failure.

IPFS is a bit different. We started using it about a year ago, starting with daily bulletins and then adding IRC logs, both in the form of HTML and plain text (the latter was added months later).

"We started using it about a year ago, starting with daily bulletins and then adding IRC logs, both in the form of HTML and plain text (the latter was added months later)."IPFS is generally good; when it works, it sure works well (albeit not quickly, the latency is incredibly high, ranging from seconds to minutes, which is unsuitable for some use cases). As I noted in the video above, this week has been more eventful than usual because the IPFS daemon started respawning endlessly and was still malfunctioning. Last night it just completely stopped working all of a sudden. With DHT traffic taking up the lion's share of the pie (unless you serve something such as video), IPFS does not scale well. It's very costly, requiring a lot of energy and bandwidth for relatively small returns. To make matters worse, it occasionally can and would become inaccessible, it can use up all the bandwidth (requiring further configuration), and it's difficult to debug. So adopting IPFS for site-related delivery of content can become a lot of work devoted to maintenance, not to mention CPU cycles and bandwidth. We have a few thousands of objects in it and it's stretching it to the limits, at least for a device with a residential connection. Several other people have reported similar issues, so we know we're not alone. What's ugly is that many of those reports -- like much of the code -- are still hosted by proprietary software (Microsoft GitHub) and are "GitHub Issues", i.e. vendor lock-in. That sends across a negative message; GitHub is an enemy of decentralisation, it's proprietary, and it is a den of arbitrary censorship on behalf of Hollywood, governments, etc.

IPFS can very quickly become utterly wasteful, just like Bitcoin and other digital (or crypto) 'coins'. But unlike coin mining, timeliness matters. IPFS can become completely inaccessible for long periods of time, with no fallbacks in place. That means downtime. We've been spending hours on IPFS this past week and it's not even serving the content (it times out); it is failing for long periods of time. It's almost impossible to debug because it is decentralised and diagnosing a swarm is incredibly difficult, akin to guesswork or "hocus pocus". One time it works, the next time it might not...

"IPFS can very quickly become utterly wasteful, just like Bitcoin and other digital (or crypto) 'coins'."As noted at the end of this video, adding a new object scales poorly (but linearly, not quadratically/exponentially) as the index of objects needs to be rebuilt from scratch (in the Go implementation at least), which means that when the number of objects doubles it can take twice as long to add new ones. If this carries on for a few years it can take an hour if not hours just to add our daily objects. Hours of CPU cycles! Maybe future/present versions tackle this issue already, so we can be patient and hope IPFS will mature/evolve gracefully. Otherwise, it is untenable for the purposes/work we've assigned to it originally (last October).

The video isn't an admission of mistake or regret; I don't personally regret pouring so much energy into IPFS, I just hope to express my thoughts on things that can be improved and probably should be improved. IPFS isn't a very young project (it has been around for quite a while), but its releases are considered not stable and work in progress. If we're part of a large experiment and the risk we take is occasional downtime (over IPFS, not Gemini or HTTP), then so be it.

Recent Techrights' Posts

The Administrative Council of the European Patent Organisation Has More Reasons Than Cocainegate to Vote for Real Change in the European Patent Office
This is about democracy and accountability in Europe
Within Weeks, Clownflare Has Collapsed Again, Time to Dump Clownflare
It's run by amateurs who, even if you maintain your site perfectly well, will render it inaccessible without prior notice
Web Developers in the US Can Already Disregard Mozilla, Firefox, and Firefox Users
"Last month, Firefox turned 21"
 
Massachusetts Institute of Theft (MIT) Nowadays in the Business of Selling SPAM to Prop Up Fashionable Pyramid Schemes
There is nothing benign about it, more so when they misuse the MIT brand to lend credibility to elaborate schemes or scams
Many IBM Departures Today (Last Friday)
Way to go, IBM leadership
Gemini Links 05/12/2025: Need for Simpler Systems, Molecular Dynamics, and More
Links for the day
Slopwatch: Not Much Today, Same as in Recent Weeks
Google News got 'conned' (maybe willingly) by one operator of several (at least 3) slopfarms that trash "Linux"
On IBM: "More Layoffs in Minnesota Are Coming" (Unverified Hearsay, for Now)
IBM is having loads of layoffs before the holidays
Links 05/12/2025: Openwashing by Microsoft's 'Open Source' Initiative, Unauthorised War Without Boundaries/Borders Waged by US
Links for the day
Finnish Politician Aura Salla Says Finland Must Dump Microsoft, Citing Security and Control Reasons, Not Costs
She says Finland should quit using Microsoft
Does This Pass the NDA "Sniff Test" at IBM?
In many companies, those who suck up to management get ahead
Links 05/12/2025: Slop Harming Democracy/Elections, More Bans Around the World on Kids' Use of Social Control Media
Links for the day
IBM Has No Layoffs, According to IBM, and According to the Media Parroting IBM
Another day of parrots (losers) who call themselves "journalists"
IBM Will Make You Unemployed On Christmas Eve
lists of people to cull
Cars Getting Worse and More Lethal
Who will be held accountable?
To "Take Back Control" Start With Actions Against 'Tech' (Mass Surveillance, Mass Censorship, Mass Control) Monopolies
collusion, price-fixing, a "cartel" of sorts
Beyond the Hype: Almost Nobody Uses Chatbots, Not Even 1% of Activity Online
3 years ago when Scam Altman (Microsoft) acted as if Google (search) was doomed a lot of the press got paid to pretend this was true
Rumour That Another IBM Round of Mass Layoffs (RAs) in Preparation Before the Current One is Even Completed
IBM still has strong brand recognition (because of its age and past might), but that won't last forever
Techrights Publication Pace to Increase Next Year
one is encouraged to stay indoors
Upgrading the Site
Debugging might be needed, so feedback helps
Why Microsoft is Panicking
Keep advocating (or "marketing") GNU/Linux to Vista 10 (or Vista 7) users... there are still over a billion of them "out there".
The Fate of "Blockchains" and "Metaverse" as a Sign of Things to Come for Slop ("AI")
Doesn't that tell us a lot about the modus operandi of these companies?
A Year After the Owner of X (Twitter) Performed Several Nazi Salutes on Stage the Germany-Based and Microsoft-Funded 'FSFE' Decides to Exit X (Twitter)
Will the real Free Software Foundation (FSF) follow suit?
EPO: What Comes Next
European media seems to have been sedated by soft bribes from cocaine addicts
Slopwatch: The Volume of Slop Has Certainly Gone Down a Lot Lately, Slop Image Providers Abandoned/Changed
It's a big improvement compared to past months
Thousands Laid Off at IBM, "Last Day" Yesterday
IBM is a dying company. This is a problem for Red Hat.
Over at Tux Machines...
GNU/Linux news for the past day
IRC Proceedings: Thursday, December 04, 2025
IRC logs for Thursday, December 04, 2025
Gemini Links 05/12/2025: Espressif ESP32-C5 UEXT Module, Pixelfed, and the Web Getting Much Worse
Links for the day
Links 04/12/2025: "People Hooked on [Slop] Far Are More Likely to Experience Mental Distress", Monopolies in Europe, and "Blogging Makes Me Feel Like A Worse Writer"
Links for the day
Dr. Andy Farnell: Can we regain control (of technology)?
"Technology as spiralling mass hysteria has the unsettling potential to draw even rational sceptics like myself into disaffection"
Links 04/12/2025: "Hey Hi" Implosion and Half of Europeans See Cheeto Trump as Enemy of Europe
Links for the day
Communication Needs Open Standards and Open Data
Standards are imperative
The "Hey Hi" House of Cards
The "Hey Hi" bubble is living on borrowed time (days or weeks) and it can implode any time now
Supporting the Free Software Foundation (FSF) Also Supports GNU Development
The FSF is mostly raising money to pay salaries
IBM's "AK Sez" Campaign
In today's media, to be characterised as important and smart one needn't be important and smart
Microsoft's Vista 11 Not Gaining, Just Plateauing or Even Going Down (Over Time)
"Desktop Windows version Market Share Worldwide"
Bubbles Popping, "Hey Hi" (AI) a Passing Fad
"Microsoft slides amid report it's cutting software sales quotas tied to AI"
At The Register MS, "Exclusive Webinar" Means Sponsored Video Ad Disguised as an Article
Why would one choose to watch these?
IBM Forces Staff to Sign an NDA If They Want Severance Package, in Effect Bribing Them or Denying Them Money They're Entitled to If They 'Disparage' IBM
We wrote about the legality or illegality of this in relation to Microsoft two years ago
IBM and Red Hat Not Done With 2025 Layoffs ("RAs") Yet
IBM isn't quite done laying off people this year, with only 3 weeks till Christmas
Gemini Links 04/12/2025: Christmas Looms, Devuan, and Programming
Links for the day
Over at Tux Machines...
GNU/Linux news for the past day
IRC Proceedings: Wednesday, December 03, 2025
IRC logs for Wednesday, December 03, 2025
Loads of People Exit IBM Tomorrow
Way to slam the door on on those who march or walk on
Slopwatch: It's Blowing, Jim (Gym), the Bubble is Blowing Up
Let's race to "zero GPT"
At IBM, "Last Day" Can be Same as Layoffs ("RAs"), Might be Euphemism Advanced by PR/HR Under NDA-Tied Conditions
They try to act all happy cheerful (in public) about becoming unemployed
Links 03/12/2025: "Disastrous Hey Hi (AI)", Breaches of Confidentiality, and "Global Democratic Recession"
Links for the day
Fake Security and 'Free' Certificates as a Trap of Planned Obsolescence and Top-Down Centralisation
The boiling frogs
Links 03/12/2025: UK Budget Leak and Criticism of Peace Posturing Over Ukraine
Links for the day
So Far Rust in Ubuntu Has Turned Out to be an Expensive Mistake
it is certainly seeming or feeling like the wrong people are in charge and they make bad decisions based on false reasoning
Gemini Links 03/12/2025: Obsession, Ubuntu, and Programming With Scheme
Links for the day
The Next Stages of EPO Coverage (and Why That Matters)
What's at stake here?
Wayland Rejection Is Not Racist
We need to collectively reject that
Reflections on a Month of Techrights Search
it looks like we've survived nearly a month without the search functionality being leveraged to stage DDoS attacks
New Year's Resolutions 4 Weeks Ahead of 2026
the main New Year's Resolution was... sleep
IBM Layoffs: It's Like They Read From a Script, Like They've Signed a Non-Disparagement Agreement/Clause
Some new departures
Over at Tux Machines...
GNU/Linux news for the past day
IRC Proceedings: Tuesday, December 02, 2025
IRC logs for Tuesday, December 02, 2025