Bonum Certa Men Certa

IPFS: The Good, the Bad, and the Exceptionally Ugly

Video download link | md5sum 43c1ae14359c4ba2d4adc78cc9e4601a



Summary: A personal and occasionally arduous experience with a whole year of IPFS; it may come across -- on the surface at least -- as an unconstructive rant, but IPFS is still a promising technology, albeit it has severe limitations that need to be properly understood (some can be technically overcome, too)

THE Web is generally not decentralised. The Internet is not decentralised, either. DNS is centralised, certificates are centralised (if you rely on the concept of 'trusted' CAs), and with most services you rely on just one address to work (for things to become accessible; it's possible to have multiple servers assigned/connected to the same address, but that's redundancy, not decentralisation).



Peer-to-peer (P2P) technologies and BitTorrent are OK, but they too have their limitations, including privacy- and censorship-related limitations. There are single points of failure.

IPFS is a bit different. We started using it about a year ago, starting with daily bulletins and then adding IRC logs, both in the form of HTML and plain text (the latter was added months later).

"We started using it about a year ago, starting with daily bulletins and then adding IRC logs, both in the form of HTML and plain text (the latter was added months later)."IPFS is generally good; when it works, it sure works well (albeit not quickly, the latency is incredibly high, ranging from seconds to minutes, which is unsuitable for some use cases). As I noted in the video above, this week has been more eventful than usual because the IPFS daemon started respawning endlessly and was still malfunctioning. Last night it just completely stopped working all of a sudden. With DHT traffic taking up the lion's share of the pie (unless you serve something such as video), IPFS does not scale well. It's very costly, requiring a lot of energy and bandwidth for relatively small returns. To make matters worse, it occasionally can and would become inaccessible, it can use up all the bandwidth (requiring further configuration), and it's difficult to debug. So adopting IPFS for site-related delivery of content can become a lot of work devoted to maintenance, not to mention CPU cycles and bandwidth. We have a few thousands of objects in it and it's stretching it to the limits, at least for a device with a residential connection. Several other people have reported similar issues, so we know we're not alone. What's ugly is that many of those reports -- like much of the code -- are still hosted by proprietary software (Microsoft GitHub) and are "GitHub Issues", i.e. vendor lock-in. That sends across a negative message; GitHub is an enemy of decentralisation, it's proprietary, and it is a den of arbitrary censorship on behalf of Hollywood, governments, etc.

IPFS can very quickly become utterly wasteful, just like Bitcoin and other digital (or crypto) 'coins'. But unlike coin mining, timeliness matters. IPFS can become completely inaccessible for long periods of time, with no fallbacks in place. That means downtime. We've been spending hours on IPFS this past week and it's not even serving the content (it times out); it is failing for long periods of time. It's almost impossible to debug because it is decentralised and diagnosing a swarm is incredibly difficult, akin to guesswork or "hocus pocus". One time it works, the next time it might not...

"IPFS can very quickly become utterly wasteful, just like Bitcoin and other digital (or crypto) 'coins'."As noted at the end of this video, adding a new object scales poorly (but linearly, not quadratically/exponentially) as the index of objects needs to be rebuilt from scratch (in the Go implementation at least), which means that when the number of objects doubles it can take twice as long to add new ones. If this carries on for a few years it can take an hour if not hours just to add our daily objects. Hours of CPU cycles! Maybe future/present versions tackle this issue already, so we can be patient and hope IPFS will mature/evolve gracefully. Otherwise, it is untenable for the purposes/work we've assigned to it originally (last October).

The video isn't an admission of mistake or regret; I don't personally regret pouring so much energy into IPFS, I just hope to express my thoughts on things that can be improved and probably should be improved. IPFS isn't a very young project (it has been around for quite a while), but its releases are considered not stable and work in progress. If we're part of a large experiment and the risk we take is occasional downtime (over IPFS, not Gemini or HTTP), then so be it.

Recent Techrights' Posts

The Munich-Based EPO is Still Using a Platform That Promotes the Far Right and Rehabilitates Nazism
Active Twitter account
How the EPO Pressures Staff Into Minting More Monopolies (Patents), Even Illegal Ones That Harm Europe and Ultimately Dismantle the Rule of Law
insights into the pressure examiners are under
LLM Slop Machines Are Not a Win for "Open Source" and If They Get Cheaper, It's Even Worse
If some program that claims to be "Open Source" pollutes the Web with fake articles (Microsoft SPAM and fake "Linux" articles), whose win is it?
Richard Stallman Speech in Bengaluru, "Silicon Valley of India"
62 years have passed since his "young nerd" days and he's still at it
More Illegal Patents at the EPO, Legality of Granted European Patents No Longer Matters to the Office
breaking the law for profit
Sharing is Caring (But Advocating Copyleft Makes You a "Target")
GPLv3 does not close all the loopholes which the "Affero" helps close
"Latest Technology News" in BetaNews Still LLM Slop and SPAM Composed by LLMs (It's Basically a Spamfarm Disguised as a News Site)
Only a fool would visit BetaNews in search of actual news
Over at Tux Machines...
GNU/Linux news for the past day
The EPO's Corruption, If It Remains Untackled, Helps the Far Right and Enemies of European Unity/Solidarity
Do not negotiate with evil
The Web, Including Wikipedia, Gets Filled With Lies About Bill Gates, Added by Bill Gates and His PR Team
Of course Wikipedia is funded by Gates
 
Google: Your Only Option is Google YouTube (Coming Soon: Mandatory DRM and Attestation?)
Digital Restrictions (DRM) to follow? Only for "approved" (attestation) browsers?
Mastodon Was Always Biased (Just Like Twitter After Abandoning Chronological and Neutral Timelines in Order to Become More Like Facebook)
So bury-brigading and click-farming control what people see
Certificate Authority Let's Encrypt Falls to Only 0.4% of the Total in Geminispace
Geminispace does not need to outsource trust
Links 29/01/2025: Dismantling Public Health in the US, Air Busan Plane Up in Flames (South Korea's Air Disasters Streak)
Links for the day
Announcements and Administrivia
This week we're going out for two days in a row to celebrate an achievement that's very respectable
Gemini Links 29/01/2025: Japan, GTD, and More
Links for the day
Sir, Yes, Sir. The Life of EPO Patent Examiners.
If working for the EPO makes it harder to sleep at night, take action
Links 29/01/2025: Data Privacy Day and Growing Tensions in Europe
Links for the day
Nazi Twitter (aka "X") Became a Troll Site That Lets People Buy a Blue Tick While Its Boss Actively Promotes Neonazi Politicians
the intellectual level of people who infest the Web through "Twitter" or "X"
This is Why They're So Afraid of Richard Stallman (He Tells People the Correct History)
Then they post about it to Microsoft's LinkedIn
Claim: Facebook Deletes Posts of IBM Red Hat Critics
As always, follow the money (advertisers)
Links 29/01/2025: Climate Crisis and "It’s time for the Xbox to fade away" (Microsoft Lose)
Links for the day
Links 29/01/2025: Buying Groceries During a Trade War, Political 'Retro'
Links for the day
Network Improvements Tomorrow
"Network maintenance" down in London
Articles About Free Speech at Facebook
'Facebook vs Linux' story is now receiving a lot more media coverage
We Were Right About stallmansupport.org Making an Error by Joining Social Control Media. mastodon.social Suspends stallmansupport.org.
From what we can guess, accounts can be banned by some oversensitive admin or a mob of users ("bury brigades")
IRC Proceedings: Tuesday, January 28, 2025
IRC logs for Tuesday, January 28, 2025
Facebook Banning Linux Sites (or People Who Link to Linux Sites) is Another Symptom of the Web's Demise
The state of media on the Web is really bad; Social Control Media amplifies the badness, as Facebook serves to show
Gemini Links 29/01/2025: Neovim Telescope and Writing Less
Links for the day
Links 28/01/2025: Chaffbot as Commodity Fad, New Import Restrictions in Thailand
Links for the day
Links 28/01/2025: "Against Social [Control] Media", "Smart" Buses' Ticketing System Cracked
Links for the day
[Video] Richard Matthew Stallman (RMS) in India, Talking About Proprietary Software's Dangers Only Yesterday
WebM file
Gemini Links 28/01/2025: Thinking About Not Much, Computing Fatigue, the Curse of JavaScript
Links for the day
"SuccessFactors" (SAP) Stunts at the EPO Used to Break Laws and Constitutions, Staff Tricked Into Harming Themselves
Ongoing corruption and lawlessness became the norm; Europe's second-largest institution (EPO) along with the largest institution (EU) has its very own Minsk
The GNU Manifesto Turns 40 in a Few Weeks
The FSF turns 40 later this year, too
Continued Support and Momentum at the Free Software Foundation (FSF)
"This helps protect our community."
Another Talk by Richard Stallman Tomorrow, This Time in Bengaluru
This means that in January 2025 he is giving at least 5 public talks
Over at Tux Machines...
GNU/Linux news for the past day
IRC Proceedings: Monday, January 27, 2025
IRC logs for Monday, January 27, 2025
Links 27/01/2025: Lukashenko's Sham Elections, TikTok for Insurrection Loyalist (Larry Ellison)?
Links for the day
Gemini Links 27/01/2025: IndieWeb Musings and Devlog
Links for the day
IBM Layoffs in "Co-location Mandate" Clothing
It's possible that later this week, around the time of the so-called 'results', many layoffs would be announced
Microsoft-Funded IDG Seems to be 'Googlebombing' the Term Free Software to Promote Proprietary Spyware Too
Microsoft advocated along with other proprietary things
Videos and Photos of Richard Stallman's (RMS) Keynote Address in India Earlier Today
He probably told the target audience (India) a thing or two about the role of proprietary software in colonialism
Rhino Linux Can (and Perhaps Should) Promote Alternatives to Microsoft Instead of Preloading Microsoft
Deeper down inside Rhino Linux there's a problem
GAFAM Hates - Except in a Worryingly Parasitic Way - GNU/Linux and Its Freedoms (or Its Users)
Let the story from DistroWatch serve as a reminder that the era of Social Control Media is over
Links 27/01/2025: Social Control Media Explores Propaganda for Racism as a Business Model, China’s Tibet Dam Criticised
Links for the day
Slashdot is Once Again Publishing Lies and Revisionism for Bill Gates, Citing Microsoft's MSN to Rewrite History and Distract From the Jeffrey Epstein Crimes
Of course this also distracts
Too Big, Will Fail (How Linux Grew Way Too Fat)
Linux has very extensive hardware support, but that comes at a cost
Richard Stallman Gives Keynote Address in a Few Hours
Richard Stallman's personal site was updated to give more details
Microsoft Relegated by Manchester United
No Microsoft
IBM Layoffs in 2025: Rumours Say Even Managers Will Get the Axe, Some Via Loopholes Like PIP and/or RTO (Preparations Already Underway)
Where does IBM's money go?
FOSDEM Talks Are Vanishing
They no longer seem to be taking money from Microsoft and/or its tentacles
Gemini Links 27/01/2025: Mental Locomotion, Gemini Protocol Bots From China, and Domain-Specific Languages
Links for the day
Microsoft Still Hires Journalists to Reward Them (Belated Payment) for Microsoft Propaganda
The PR/lying pipeline
Over at Tux Machines...
GNU/Linux news for the past day
IRC Proceedings: Sunday, January 26, 2025
IRC logs for Sunday, January 26, 2025