Bonum Certa Men Certa

The Computer Anybody Can Edit

2020 figosdev

Index



Sound board
Chapter 10: The Computer Anybody Can Edit



Summary: "Without rebuilding and recompiling all of the packages on a large distribution, it is possible to "remaster" an ISO and get a different system -- even before you install it."

The goal of Free Software is for all software to be Free as in Freedom -- for you to be free to Use, Study, Change and Share the software.



Editing Wikipedia is as simple as clicking Edit and changing the text.

"Without rebuilding and recompiling all of the packages on a large distribution, it is possible to "remaster" an ISO and get a different system -- even before you install it."Installing a different operating system is sometimes as simple as downloading a file, writing it to a CD, DVD or USB, booting the computer with that and then using it to write the same to the computer itself.

Ideally, changing that download would be as easy to edit as Wikipedia.

Some will argue that it already is that easy, but that isn't entirely true. While I don't believe that you (or by extension, anybody else) are obligated to work with other people on a project, ideally we would facilitate both working on projects as groups or as individuals, at their option.

Besides, just because what I'm talking about is partially implemented, doesn't mean you can just download Debian for example, click "Edit" and have a new bootable ISO.

"You wouldn't want to remaster and install an ISO just to add leafpad to your system, of course."The ISO is not the only way to install GNU/Linux, but it is the way to get it onto a CD or DVD that you can use to do installation. Without rebuilding and recompiling all of the packages on a large distribution, it is possible to "remaster" an ISO and get a different system -- even before you install it.

"To edit Wikipedia, not only do you have to get past a lot of politics to create edits, you need to learn the code -- the wiki syntax in particular."Distros conventionally arrange software into "packages" -- a package is a group of files, and installing software in a modular way typically pulls in a handful of support packages which are needed to make the software work. For example, to install Leafpad in Debian you would just say:

    sudo apt-get install leafpad


Why are there three commands instead of one? Let's look at the way this works:

"sudo" - this lets you run things that need root/administrator privileges from a user-level prompt. Typically it will ask for a root password when you run it.

"apt-get" - this is the actual package manager command. It tells the computer what you want to install.

"install" - this is a superfluous "parameter" or option for the apt-get command. If there were a command called apt-get-install (or just "install") then you wouldn't need this; the only reason you need it is because that's how the apt-get authors designed it.

There are good arguments to be made for not calling a command something as generic as "install", but it would be ideal if the command were apt-install or aptinstall rather than apt-get install. Obviously, this is a quibble. But apt-get install is the most common usage of apt that most people know.

"leafpad" - while this is the name of the program you wanted, specifically it is the name of the package you want to download and install to the operating system.

You wouldn't want to remaster and install an ISO just to add leafpad to your system, of course. You want the option of installing new programs to an already-installed OS. But you you don't just want the freedom to use, study, change and share individual programs. Ideally, you would be able to do the same thing with distros. Technically this is possible, but what it isn't is easy.

"If you don't like a change it makes, you can just remove those lines. Editing an operating system is like editing a wiki!"To edit Wikipedia, not only do you have to get past a lot of politics to create edits, you need to learn the code -- the wiki syntax in particular. Wiki syntax was originally created to make it easier to edit the HTML code in Web pages.

Instead of 4 angle brackets, quotes and repeating the name of the closing tag with a /, you can just say [[article name]] to create a link to another page for example. For a single link these are small savings, but for editing an encyclopedia the difference in convenience and readability is substantial.

It would be cool if you could simply open a file, change a few things you wanted to be different in your GNU/Linux distro, and run a command to create a different ISO. Existing remastering tools tend to fall into two categories: serious developer tools that can do nearly anything, and toy remastering utilities that give you a taste of real power, but make it tedious (and manual) to do lots of work.

Distro-libre was my own effort to make toys that can do anything. I started by creating a toy programming language, with fewer than 100 commands. While this language is very simple, it translates automatically to Python code that you can run on almost any GNU/Linux system.

The language can also run shell code, so I had it call code to open an ISO, decompress the filesystem, make changes and zip it back up. Syslinux has a tool called isohybrid that turns your bootable ISO into one you can write to a USB with a single command: dd if=name-of-iso of=/dev/sdx, where sdx is the device you are writing to. Lots of distros offer hybrid ISOs that can be written to USB, but distro-libre runs isohybrid for you.

The goal here was to make the ISO itself optional. An ISO is a large file -- sometimes more than 1 GB (that's a lot for an amateur to host -- Devuan for example, doesn't even archive its older versions). With distro-libre, instead of making a few changes to an ISO and then uploading and hosting a gigabyte or half of one for people to download, you can simply download a text file written in a wiki-like programming language and run THAT instead.

What this accomplishes is that if you are remastering say, Debian 9 -- it can download the Debian 9 ISO, automatically open / decompress / change / compress / write the ISO / hybridise it and spit it out into a new ISO, all automatically.

It is automatic, though you are in complete control of it -- because it is a single file that has one or a few lines for every single change.

"After creating my own ISO based more exclusively on Refracta, I set out to remaster more distros, and used Distro-libre to remove systemd from both Trisquel 8 and Debian 9 -- to show it could be done by an automatic remastering tool."If you don't like a change it makes, you can just remove those lines. Editing an operating system is like editing a wiki!

There are a few things to note about this system -- one is that I never wanted the job of remastering distros. I was hoping Debian would always be true enough to itself and to free software to take care of that for us. I only started remastering after Debian and Devuan failed to be projects I could rely on, and I never thought Debian would become unreliable or corrupt as a project.

I didn't even set out to remaster distros, I was writing a toy/demo program (it's the truth) to analyse the contents of ISO files. Eventually I realised how close it was to a remastering program and I added the features needed to make it one.

My first distro was created with my own programming language -- one of the drawbacks of most (not all) remastering programs is they are specific to the distro family they are created for. Instead of a family-specific remaster tool, I wanted something that could (in theory, and hopefully in practice) remaster any distro. I adapted it to remaster Puppy, Refracta, Debian, Trisquel, Void, Tiny Core and others.

Once I was able to remaster, I set out to mix two distributions into a single ISO -- Puppy Linux and Refracta. I still didn't plan on more than experimenting with mixing ISOs together.

After creating my own ISO based more exclusively on Refracta, I set out to remaster more distros, and used Distro-libre to remove systemd from both Trisquel 8 and Debian 9 -- to show it could be done by an automatic remastering tool.

Although I wasn't sure of this at first, I didn't create the first automatic remaster tool for the purpose of making a new distro from an existing one -- OLPC has created a similar tool to make an OLPC software platform from Ubuntu

To give you an idea of how this works in practice, an author can take some code that is designed to add or remove Leafpad to an existing iso, and put some code around it like this:

    function add_leafpad



CODE GOES HERE

next


The "function" and "next" commands mark the start and end of the section of code that install leafpad. So you can have one or several lines of code there, then you can have another section of code (say at the bottom) which says things like:

    now add_leafpad
    now remove_systemd
    now add_sysvinit
    now delete_icons # saves space!
    now remove_langsupport
    now add_en_gb


The "now" command isn't a command, it is actually a variable name. If you prefer, you could just use a single letter, like p:

    p add_leafpad
    p remove_systemd
    p add_sysvinit
    p delete_icons # saves space!
    p remove_langsupport
    p add_en_gb


Fig (the language this is written in) is a simple, educational general-purpose language. Suppose you don't want distro-libre to be a bunch of functions, you would rather turn fig into a language designed specifically for writing remastering scripts. I support this! Fig is language implemented in Python (it also works in PyPy) and it translates fig code to Python. Adding functions is easier than most language (I've modified far more complicated ones)

I started calling the collection of remaster routines in my remaster script "distro-libre" because I thought it would be ideal if we used it to make fully-free versions of EVERY DISTRO.

Since there are only hundreds, and many are ones that people don't care about at all, and making one work with distro-libre (it usually took a day or two, maybe a few days to work distro-libre into something that could remaster a new type of distro) gives you access to several others in the same family-

I figured instead of working so hard to make a few "fully free" distros we could just do as many as people cared about. The one thing they would lack is a libre kernel, and if people cared enough to remove the non-free software from every distro, we could probably get enough people interested in replacing the kernel as well.

So what happened? A few things. Unsurprisingly, I didn't find enough people interested in making this happen. One of the Devuan maintainers actually attacked me for my idea of automated remaster scripts, and it's very difficult to get any sort of idea going within the Devuan project, their wagons are just as circled as Debian's are.

I do think Denis Roio, the leader of Devuan (as well as Dyne.org) is a good guy, I even considered him as someone who could take over for rms someday. But the project itself has a number of problems that I doubt they will ever fix. Dyne is probably still the sort of organisation I would be willing to give money to, but Dyne:bolic (which Roio created) was a better project than Devuan in many ways.

Finding a community interested in distro-libre isn't really even the biggest problem though. The biggest problem is the direction GNU/Linux itself is headed in, and that's just one more reason why Hyperbola is setting such a great example for all other free software distros.

This chapter will stop here, though I want to mention that there are two things these chapters are not designed to do, which you would be well justified in suspecting anyway.

"...Hyperbola happens to be the only one taking several threats seriously that I consider relevant to the demise of Free software."The purpose of this book, I promise -- is NOT to promote HyperbolaBSD. It may do so, because out of hundreds of distros (and a dozen "fully free" ones) Hyperbola happens to be the only one taking several threats seriously that I consider relevant to the demise of Free software. I have some criticisms for Hyperbola as well (nothing is perfect -- I don't even use Hyperbola, though I would be very interested in trying it).

The reason I keep "plugging" Hyperbola and saying nice things about it is very simply credit-where-credit is due. I've never even used their distro -- I downloaded it and had a look at how it is put together, before they switched to BSD I think. I AM interested in libre versions of BSD, for reasons this book will hopefully explain at the right time...

The other thing this book is not deliberately doing, is teasing you about other chapters that I haven't even (as of this writing) written yet. In other words, I'm not going that to try to create suspense or interest. If it achieves that effect, great! But its honestly not intentional. Rather, I can only introduce so many things at the same time, and I'm trying to lay a foundation as much as possible. After writing the first 9 chapters of this book, I went through nearly 100 freely-licensed articles I've written to decide which topic was best to cover next.

This particular chapter is inspired by part 7 of the book this is intended to bring up to date-

Guarding and Rescuing the FSF Titanic: Distro-libre and feature-schema

That book (along with another book I wrote, in better detail) predicted the ousting of rms from the FSF, and was written based on the idea that we could save the FSF from itself -- like a fleet of lifeboats running alongside the Titanic, which didn't bother including a sufficient number of them.

Since that was written, I no longer think the FSF can be saved -- but I do think Free Software is still important. Many of the problems ahead are what to do about the Linux kernel and Microsoft GitHub. I still think distro-libre is a good idea, but sadly there are problems now that are so foundational that remixing all distros into fully free ones brings up some related issues that have to be addressed.

Licence: Creative Commons CC0 1.0 (public domain)

Recent Techrights' Posts

A Week After a Worldwide Windows Outage Microsoft is 'Bricking' Windows All On Its Own, Cannot Blame Others Anymore
A look back at a week of lousy press coverage, Microsoft deceit, and lessons to be learned
 
Links 26/07/2024: Tesco Cutbacks and Fake Patent Courts
Links for the day
Links 26/07/2024: Grimy Residue of the 'AI' Bubble and Tensions Around Alaska
Links for the day
Gemini Links 26/07/2024: More Computers and Tilde Hosting
Links for the day
Links 26/07/2024: "AI" Hype Debunked and Elon Musk's "X" Already Spreads Political Disinformation
Links for the day
"Why you boss is insatiably horny for firing you and replacing you with software."
Ask McDonalds how this "AI" nonsense with IBM worked out for them
No Olympics
We really need to focus on real news
Nobody Holds the GNOME Foundation Accountable (Not Even IRS), It's Governed by Lawyers, Not Geeks, and Headed by a Shaman Crank
GNOME is a deeply oppressive institutions that eats its own
[Meme] The 'Modern' Web and 'Linux' Foundation Reinforcing Monopolies and Cementing centralisation
They don't care about the users and issuing a few bytes with random characters costs them next to nothing. It gives them control over billions of human beings.
'Boiling the Frog' or How Online Certificate Status Protocol (OCSP) is Being Abandoned at Short Notice by Let's Encrypt
This isn't a lack of foresight but planned obsolescence
When the LLM Bubble Implodes Completely Microsoft Will be 'Finished'
Excuses like, "it's not ready yet" or "we'll fix it" won't pass muster
"An escalator can never break: it can only become stairs"
The lesson of this story is, if you do evil things, bad things will come your way. So don't do evil things.
When Wikileaks Was Still Primarily a Wiki
less than 14 years ago the international media based its war journalism on what Wikileaks had published
The Free Software Foundation Speaks Out Against Microsoft
the problem is bigger than Microsoft and in the long run - seeing Microsoft's demise - we'll need to emphasise Software Freedom
IRC Proceedings: Thursday, July 25, 2024
IRC logs for Thursday, July 25, 2024
Over at Tux Machines...
GNU/Linux news for the past day
Links 26/07/2024: E-mail on OpenBSD and Emacs Fun
Links for the day
Links 25/07/2024: Talks of Increased Pension Age and Biden Explains Dropping Out
Links for the day
Links 25/07/2024: Paul Watson, Kernel Bug, and Taskwarrior
Links for the day
[Meme] Microsoft's "Dinobabies" Not Amused
a slur that comes from Microsoft's friends at IBM
Flashback: Microsoft Enslaves Black People (Modern Slavery) for Profit, or Even for Losses (Still Sinking in Debt Due to LLMs' Failure)
"Paid Kenyan Workers Less Than $2 Per Hour"
From Lion to Lamb: Microsoft Fell From 100% to 13% in Somalia (Lowest Since 2017)
If even one media outlet told you in 2010 that Microsoft would fall from 100% (of Web requests) to about 1 in 8 Web requests, you'd probably struggle to believe it
Microsoft Windows Became Rare in Antarctica
Antarctica's Web stats still near 0% for Windows
Links 25/07/2024: YouTube's Financial Problem (Even After Mass Layoffs), Journalists Bemoan Bogus YouTube Takedown Demands
Links for the day
Gemini Now 70 Capsules Short of 4,000 and Let's Encrypt Sinks Below 100 (Capsules) as Self-Signed Leaps to 91%
The "gopher with encryption" protocol is getting more widely used and more independent from GAFAM
Over at Tux Machines...
GNU/Linux news for the past day
IRC Proceedings: Wednesday, July 24, 2024
IRC logs for Wednesday, July 24, 2024
Techrights Statement on YouTube
YouTube is a dying platform
[Video] Julian Assange on the Right to Know
Publishing facts is spun as "espionage" by the US government and "treason" by the Russian government, to give two notable examples
Links 25/07/2024: Tesla's 45% Profit Drop, Humble Games Employees All Laid Off
Links for the day
Gemini Links 25/07/2024: Losing Grip and collapseOS
Links for the day
LWN (Earlier This Week) is GAFAM Openwashing Amplified
Such propaganda and openwashing make one wonder...
Open Source Initiative (OSI) Blog: Microsoft Operatives Promoting Proprietary Software for Microsoft
This is corruption
Libre-SOC Insiders Explain How Libre-SOC and Funding for Libre-SOC (From NLNet) Got 'Hijacked' or Seized
One worked alongside my colleagues and I in 2011
Why We're Revealing the Ugly Story of What Happened at Libre-SOC
Aside from the fact that some details are public already
Removing the Lid Off of 'Cancel Culture' (in Tech) and Shutting It Down by Illuminating the Tactics and Key Perpetrators
Corporate militants disguised as "good manners"
FSF, Which Pioneered GNU/Linux Development, Needs 32 More New Members in 2.5 Days
To meet the goal of a roughly month-long campaign
Lupa Statistics, Based on Crawling Geminispace, Will Soon Exceed Scope of 4,000 Capsules
Capsules or unique capsules or online capsules are in the thousands and growing
Links 24/07/2024: Many New Attacks on Journalists, "Private Companies Own The Law"
Links for the day
Gemini Links 24/07/2024: Face à Gaïa, Emacs Timers for Weekly Event, Chromebook Survives Water Torture
Links for the day
Why Virtually All the Wikileaks Copycats, Forks, and Rivals Basically Perished
Cryptome is like the "grandpa" of them all
A Total Lack of Transparency: Open and Free Technology Community (OFTC) Fails to Explain Why Over 60% of Users Are Gone (Since a Week Ago)
IRC giants have fallen
In the United Kingdom Google Search Rises to All-Time High, Microsoft Fell Nearly 1.5% Since the LLM Hype Began
Microsoft is going to need actual products or it will gradually vanish from the market
Trying to Put Out the Fire at Microsoft
Microsoft is drowning in debt while laying off loads of staff, hoping it can turn things around
GNU/Linux Growing at Vista 11's Expense
it's tempting to deduce many people who got PCs with Vista 11 preinstalled are deleting it, only to replace it with GNU/Linux
Over at Tux Machines...
GNU/Linux news for the past day
IRC Proceedings: Tuesday, July 23, 2024
IRC logs for Tuesday, July 23, 2024