Bonum Certa Men Certa

IPFS: The Good, the Bad, and the Exceptionally Ugly

Video download link | md5sum 43c1ae14359c4ba2d4adc78cc9e4601a



Summary: A personal and occasionally arduous experience with a whole year of IPFS; it may come across -- on the surface at least -- as an unconstructive rant, but IPFS is still a promising technology, albeit it has severe limitations that need to be properly understood (some can be technically overcome, too)

THE Web is generally not decentralised. The Internet is not decentralised, either. DNS is centralised, certificates are centralised (if you rely on the concept of 'trusted' CAs), and with most services you rely on just one address to work (for things to become accessible; it's possible to have multiple servers assigned/connected to the same address, but that's redundancy, not decentralisation).



Peer-to-peer (P2P) technologies and BitTorrent are OK, but they too have their limitations, including privacy- and censorship-related limitations. There are single points of failure.

IPFS is a bit different. We started using it about a year ago, starting with daily bulletins and then adding IRC logs, both in the form of HTML and plain text (the latter was added months later).

"We started using it about a year ago, starting with daily bulletins and then adding IRC logs, both in the form of HTML and plain text (the latter was added months later)."IPFS is generally good; when it works, it sure works well (albeit not quickly, the latency is incredibly high, ranging from seconds to minutes, which is unsuitable for some use cases). As I noted in the video above, this week has been more eventful than usual because the IPFS daemon started respawning endlessly and was still malfunctioning. Last night it just completely stopped working all of a sudden. With DHT traffic taking up the lion's share of the pie (unless you serve something such as video), IPFS does not scale well. It's very costly, requiring a lot of energy and bandwidth for relatively small returns. To make matters worse, it occasionally can and would become inaccessible, it can use up all the bandwidth (requiring further configuration), and it's difficult to debug. So adopting IPFS for site-related delivery of content can become a lot of work devoted to maintenance, not to mention CPU cycles and bandwidth. We have a few thousands of objects in it and it's stretching it to the limits, at least for a device with a residential connection. Several other people have reported similar issues, so we know we're not alone. What's ugly is that many of those reports -- like much of the code -- are still hosted by proprietary software (Microsoft GitHub) and are "GitHub Issues", i.e. vendor lock-in. That sends across a negative message; GitHub is an enemy of decentralisation, it's proprietary, and it is a den of arbitrary censorship on behalf of Hollywood, governments, etc.

IPFS can very quickly become utterly wasteful, just like Bitcoin and other digital (or crypto) 'coins'. But unlike coin mining, timeliness matters. IPFS can become completely inaccessible for long periods of time, with no fallbacks in place. That means downtime. We've been spending hours on IPFS this past week and it's not even serving the content (it times out); it is failing for long periods of time. It's almost impossible to debug because it is decentralised and diagnosing a swarm is incredibly difficult, akin to guesswork or "hocus pocus". One time it works, the next time it might not...

"IPFS can very quickly become utterly wasteful, just like Bitcoin and other digital (or crypto) 'coins'."As noted at the end of this video, adding a new object scales poorly (but linearly, not quadratically/exponentially) as the index of objects needs to be rebuilt from scratch (in the Go implementation at least), which means that when the number of objects doubles it can take twice as long to add new ones. If this carries on for a few years it can take an hour if not hours just to add our daily objects. Hours of CPU cycles! Maybe future/present versions tackle this issue already, so we can be patient and hope IPFS will mature/evolve gracefully. Otherwise, it is untenable for the purposes/work we've assigned to it originally (last October).

The video isn't an admission of mistake or regret; I don't personally regret pouring so much energy into IPFS, I just hope to express my thoughts on things that can be improved and probably should be improved. IPFS isn't a very young project (it has been around for quite a while), but its releases are considered not stable and work in progress. If we're part of a large experiment and the risk we take is occasional downtime (over IPFS, not Gemini or HTTP), then so be it.

Recent Techrights' Posts

Microsoft Windows Falls to 19% in Congo, Only About 1 in 8 Windows Users (or 2-3% of Web Users) Are on Vista 11
The estimated share of Vista 11 fell sharply this past month
Twitter as X-Rated Hatred: Criticising Microsoft is Not OK, Calling for Beheadings (With Bounties on People's Heads) is OK
Twitter automation missed 'hit job' advertising
 
Another Case Study Regarding Edge's Death
people adopt Chrome and a lot more people use obscure browsers than adopt the latest Edge
[Meme] A Question of Interests
'The Internet? We are not interested in it.' -Bill Gates, 1993
In the Romanian Browser Market, Microsoft is the 2% (Edge Down to 2.3%)
the Wintel era has ended
Gemini Links 17/08/2024: Selfishness and Offline BBSing
Links for the day
Frans Pop & Debian Day 2024: 31 years of deception and modern slavery
Reprinted with permission from Daniel Pocock
Over at Tux Machines...
GNU/Linux news for the past day
IRC Proceedings: Friday, August 16, 2024
IRC logs for Friday, August 16, 2024
Links 16/08/2024: YouTube Bans and Surveillance Expanded
Links for the day
We Were Right All Along and the Collaborators of Microsoft Helped Competition Crimes of Microsoft
Once again vindicated regarding UEFI "secure boot"
[Meme] The New Windows Slogan
stat me up
Addendum: Associate's Notes on Free Software as a Labour Issue and the Connectivity Swindles
these are related issues/causes
Microsofters Infiltrating Roles of Authority and Government Positions to Protect Microsoft and to FUD Microsoft's Competition
friends of Microsofters who bully me and my wife
Links 16/08/2024: UK Skills Deficit and Kim Dotcom to be Extradited to the US (for Doing the Same Stuff GAFAM Does)
Links for the day
Gemini Links 16/08/2024: Overgeneralisation and Games
Links for the day
Russia's Yandex 5 Times Bigger Than Microsoft... in Ukraine
They'd rather rely on the Kremlin than on Microsoft
[Meme] Gemini is Different, So What?
different, not worse
Now It's "Official": Over 4,000 Known Gemini Capsules in Lupa
For the first time ever
Clown Computing
Reprinted with permission from Dr. Andy Farnell
[Meme] What Freedom Means to IBM
Free labou
Balancing Activism Against (or With) Basic Necessities and Daniel Cantarín on Our Collective Battle for Software Freedom Around the World
"I'm VERY angry about lots of stuff happening here in Argentina, all of it shielded behind the word "freedom"."
Over at Tux Machines...
GNU/Linux news for the past day
IRC Proceedings: Thursday, August 15, 2024
IRC logs for Thursday, August 15, 2024
From 99% in 2012 to 27% in 2024: How Microsoft Lost Georgia
What we're seeing is a migration from Windows to other platforms, notably GNU/Linux
To Understand Cisco's Mass Layoffs Look at the Company's Soaring Debt (Same at Microsoft)
Look what's happening to Intel - down almost 60% since the start of the year, 57% to be precise
Windows Flying Low at 25%
It's another all-time low
[Meme] Long Texts You Never Bother Reading (Because Life is Too Short, Unlike Those Texts)
The devil is in the terms of service
Links 15/08/2024: Monkeypox Hysteria and Modern Homesteaders Living Off the Grid
Links for the day
Gemini Links 15/08/2024: Confession of a Convention Game Master and Some Release nostalgia
Links for the day
Congratulations to Romania, Where Windows is Now "Minority Market Share" Platform
Time will tell if GNU/Linux can pass 5% on the desktop/laptop "form factor" there
Why It Matters That 4,000 Gemini Capsules Are Known to Lupa and Why Gemini Protocol Matters to Us
I have no doubt Gemini Protocol will continue to expand because it solves a real problem
Links 15/08/2024: Avast Surveillance Scandal Unsolved and Facebook Still Censors Terror Sympathisers
Links for the day
Daniel Cantarín's Response to Alexandre Oliva's Talk on Achieving Software Freedom in the Age of Platform Decay
Soylent News caught up with the series
4,000 Gemini Capsules
it's basically one capsule short of 4,000
"Microsoft is a Sponsor of The New Stack."
Many articles turn out to be just ads
New Highs for Android in Russia, But It's Reportedly Working on Its Own Linux-Based Operating Systems (GAFAM-Free)
statCounter isn't equipped to properly parse user agents or to keep up
Upcoming Series: Terms of Service (TOS) Under the Microscope, FSF Party, GitHub Scandals, Clowns, and More
Right now we have way more material than we have time to cover. But that's a good thing.
Gemini Links 15/08/2024: Lies of Therapy and Web Applications
Links for the day
Software Freedom in Perspective - Part 5 - When Richard Stallman Came to Argentina
It might seem a bit harsh, but a discussion at the end of this series will tie things together and explain why those things were said
Over at Tux Machines...
GNU/Linux news for the past day
IRC Proceedings: Wednesday, August 14, 2024
IRC logs for Wednesday, August 14, 2024