Bonum Certa Men Certa

The Computer Anybody Can Edit

2020 figosdev

Index



Sound board
Chapter 10: The Computer Anybody Can Edit



Summary: "Without rebuilding and recompiling all of the packages on a large distribution, it is possible to "remaster" an ISO and get a different system -- even before you install it."

The goal of Free Software is for all software to be Free as in Freedom -- for you to be free to Use, Study, Change and Share the software.



Editing Wikipedia is as simple as clicking Edit and changing the text.

"Without rebuilding and recompiling all of the packages on a large distribution, it is possible to "remaster" an ISO and get a different system -- even before you install it."Installing a different operating system is sometimes as simple as downloading a file, writing it to a CD, DVD or USB, booting the computer with that and then using it to write the same to the computer itself.

Ideally, changing that download would be as easy to edit as Wikipedia.

Some will argue that it already is that easy, but that isn't entirely true. While I don't believe that you (or by extension, anybody else) are obligated to work with other people on a project, ideally we would facilitate both working on projects as groups or as individuals, at their option.

Besides, just because what I'm talking about is partially implemented, doesn't mean you can just download Debian for example, click "Edit" and have a new bootable ISO.

"You wouldn't want to remaster and install an ISO just to add leafpad to your system, of course."The ISO is not the only way to install GNU/Linux, but it is the way to get it onto a CD or DVD that you can use to do installation. Without rebuilding and recompiling all of the packages on a large distribution, it is possible to "remaster" an ISO and get a different system -- even before you install it.

"To edit Wikipedia, not only do you have to get past a lot of politics to create edits, you need to learn the code -- the wiki syntax in particular."Distros conventionally arrange software into "packages" -- a package is a group of files, and installing software in a modular way typically pulls in a handful of support packages which are needed to make the software work. For example, to install Leafpad in Debian you would just say:

    sudo apt-get install leafpad


Why are there three commands instead of one? Let's look at the way this works:

"sudo" - this lets you run things that need root/administrator privileges from a user-level prompt. Typically it will ask for a root password when you run it.

"apt-get" - this is the actual package manager command. It tells the computer what you want to install.

"install" - this is a superfluous "parameter" or option for the apt-get command. If there were a command called apt-get-install (or just "install") then you wouldn't need this; the only reason you need it is because that's how the apt-get authors designed it.

There are good arguments to be made for not calling a command something as generic as "install", but it would be ideal if the command were apt-install or aptinstall rather than apt-get install. Obviously, this is a quibble. But apt-get install is the most common usage of apt that most people know.

"leafpad" - while this is the name of the program you wanted, specifically it is the name of the package you want to download and install to the operating system.

You wouldn't want to remaster and install an ISO just to add leafpad to your system, of course. You want the option of installing new programs to an already-installed OS. But you you don't just want the freedom to use, study, change and share individual programs. Ideally, you would be able to do the same thing with distros. Technically this is possible, but what it isn't is easy.

"If you don't like a change it makes, you can just remove those lines. Editing an operating system is like editing a wiki!"To edit Wikipedia, not only do you have to get past a lot of politics to create edits, you need to learn the code -- the wiki syntax in particular. Wiki syntax was originally created to make it easier to edit the HTML code in Web pages.

Instead of 4 angle brackets, quotes and repeating the name of the closing tag with a /, you can just say [[article name]] to create a link to another page for example. For a single link these are small savings, but for editing an encyclopedia the difference in convenience and readability is substantial.

It would be cool if you could simply open a file, change a few things you wanted to be different in your GNU/Linux distro, and run a command to create a different ISO. Existing remastering tools tend to fall into two categories: serious developer tools that can do nearly anything, and toy remastering utilities that give you a taste of real power, but make it tedious (and manual) to do lots of work.

Distro-libre was my own effort to make toys that can do anything. I started by creating a toy programming language, with fewer than 100 commands. While this language is very simple, it translates automatically to Python code that you can run on almost any GNU/Linux system.

The language can also run shell code, so I had it call code to open an ISO, decompress the filesystem, make changes and zip it back up. Syslinux has a tool called isohybrid that turns your bootable ISO into one you can write to a USB with a single command: dd if=name-of-iso of=/dev/sdx, where sdx is the device you are writing to. Lots of distros offer hybrid ISOs that can be written to USB, but distro-libre runs isohybrid for you.

The goal here was to make the ISO itself optional. An ISO is a large file -- sometimes more than 1 GB (that's a lot for an amateur to host -- Devuan for example, doesn't even archive its older versions). With distro-libre, instead of making a few changes to an ISO and then uploading and hosting a gigabyte or half of one for people to download, you can simply download a text file written in a wiki-like programming language and run THAT instead.

What this accomplishes is that if you are remastering say, Debian 9 -- it can download the Debian 9 ISO, automatically open / decompress / change / compress / write the ISO / hybridise it and spit it out into a new ISO, all automatically.

It is automatic, though you are in complete control of it -- because it is a single file that has one or a few lines for every single change.

"After creating my own ISO based more exclusively on Refracta, I set out to remaster more distros, and used Distro-libre to remove systemd from both Trisquel 8 and Debian 9 -- to show it could be done by an automatic remastering tool."If you don't like a change it makes, you can just remove those lines. Editing an operating system is like editing a wiki!

There are a few things to note about this system -- one is that I never wanted the job of remastering distros. I was hoping Debian would always be true enough to itself and to free software to take care of that for us. I only started remastering after Debian and Devuan failed to be projects I could rely on, and I never thought Debian would become unreliable or corrupt as a project.

I didn't even set out to remaster distros, I was writing a toy/demo program (it's the truth) to analyse the contents of ISO files. Eventually I realised how close it was to a remastering program and I added the features needed to make it one.

My first distro was created with my own programming language -- one of the drawbacks of most (not all) remastering programs is they are specific to the distro family they are created for. Instead of a family-specific remaster tool, I wanted something that could (in theory, and hopefully in practice) remaster any distro. I adapted it to remaster Puppy, Refracta, Debian, Trisquel, Void, Tiny Core and others.

Once I was able to remaster, I set out to mix two distributions into a single ISO -- Puppy Linux and Refracta. I still didn't plan on more than experimenting with mixing ISOs together.

After creating my own ISO based more exclusively on Refracta, I set out to remaster more distros, and used Distro-libre to remove systemd from both Trisquel 8 and Debian 9 -- to show it could be done by an automatic remastering tool.

Although I wasn't sure of this at first, I didn't create the first automatic remaster tool for the purpose of making a new distro from an existing one -- OLPC has created a similar tool to make an OLPC software platform from Ubuntu

To give you an idea of how this works in practice, an author can take some code that is designed to add or remove Leafpad to an existing iso, and put some code around it like this:

    function add_leafpad



CODE GOES HERE

next


The "function" and "next" commands mark the start and end of the section of code that install leafpad. So you can have one or several lines of code there, then you can have another section of code (say at the bottom) which says things like:

    now add_leafpad
    now remove_systemd
    now add_sysvinit
    now delete_icons # saves space!
    now remove_langsupport
    now add_en_gb


The "now" command isn't a command, it is actually a variable name. If you prefer, you could just use a single letter, like p:

    p add_leafpad
    p remove_systemd
    p add_sysvinit
    p delete_icons # saves space!
    p remove_langsupport
    p add_en_gb


Fig (the language this is written in) is a simple, educational general-purpose language. Suppose you don't want distro-libre to be a bunch of functions, you would rather turn fig into a language designed specifically for writing remastering scripts. I support this! Fig is language implemented in Python (it also works in PyPy) and it translates fig code to Python. Adding functions is easier than most language (I've modified far more complicated ones)

I started calling the collection of remaster routines in my remaster script "distro-libre" because I thought it would be ideal if we used it to make fully-free versions of EVERY DISTRO.

Since there are only hundreds, and many are ones that people don't care about at all, and making one work with distro-libre (it usually took a day or two, maybe a few days to work distro-libre into something that could remaster a new type of distro) gives you access to several others in the same family-

I figured instead of working so hard to make a few "fully free" distros we could just do as many as people cared about. The one thing they would lack is a libre kernel, and if people cared enough to remove the non-free software from every distro, we could probably get enough people interested in replacing the kernel as well.

So what happened? A few things. Unsurprisingly, I didn't find enough people interested in making this happen. One of the Devuan maintainers actually attacked me for my idea of automated remaster scripts, and it's very difficult to get any sort of idea going within the Devuan project, their wagons are just as circled as Debian's are.

I do think Denis Roio, the leader of Devuan (as well as Dyne.org) is a good guy, I even considered him as someone who could take over for rms someday. But the project itself has a number of problems that I doubt they will ever fix. Dyne is probably still the sort of organisation I would be willing to give money to, but Dyne:bolic (which Roio created) was a better project than Devuan in many ways.

Finding a community interested in distro-libre isn't really even the biggest problem though. The biggest problem is the direction GNU/Linux itself is headed in, and that's just one more reason why Hyperbola is setting such a great example for all other free software distros.

This chapter will stop here, though I want to mention that there are two things these chapters are not designed to do, which you would be well justified in suspecting anyway.

"...Hyperbola happens to be the only one taking several threats seriously that I consider relevant to the demise of Free software."The purpose of this book, I promise -- is NOT to promote HyperbolaBSD. It may do so, because out of hundreds of distros (and a dozen "fully free" ones) Hyperbola happens to be the only one taking several threats seriously that I consider relevant to the demise of Free software. I have some criticisms for Hyperbola as well (nothing is perfect -- I don't even use Hyperbola, though I would be very interested in trying it).

The reason I keep "plugging" Hyperbola and saying nice things about it is very simply credit-where-credit is due. I've never even used their distro -- I downloaded it and had a look at how it is put together, before they switched to BSD I think. I AM interested in libre versions of BSD, for reasons this book will hopefully explain at the right time...

The other thing this book is not deliberately doing, is teasing you about other chapters that I haven't even (as of this writing) written yet. In other words, I'm not going that to try to create suspense or interest. If it achieves that effect, great! But its honestly not intentional. Rather, I can only introduce so many things at the same time, and I'm trying to lay a foundation as much as possible. After writing the first 9 chapters of this book, I went through nearly 100 freely-licensed articles I've written to decide which topic was best to cover next.

This particular chapter is inspired by part 7 of the book this is intended to bring up to date-

Guarding and Rescuing the FSF Titanic: Distro-libre and feature-schema

That book (along with another book I wrote, in better detail) predicted the ousting of rms from the FSF, and was written based on the idea that we could save the FSF from itself -- like a fleet of lifeboats running alongside the Titanic, which didn't bother including a sufficient number of them.

Since that was written, I no longer think the FSF can be saved -- but I do think Free Software is still important. Many of the problems ahead are what to do about the Linux kernel and Microsoft GitHub. I still think distro-libre is a good idea, but sadly there are problems now that are so foundational that remixing all distros into fully free ones brings up some related issues that have to be addressed.

Licence: Creative Commons CC0 1.0 (public domain)

Recent Techrights' Posts

SoylentNews Grows Up, Registers as a Business, Site Traffic Reportedly Grows
More people realise that social control media may in fact be a passing fad
 
Garden Season Starts Today
Outdoor time, officially...
More Information About Public Talks That Richard Stallman Gave This Week in Europe
Two talks in Switzerland
Engadget is Still a Spamfarm, It's Just an Amazon Catalogue (SPAM/SEO), a Sea of Junk Disguised as "Articles" With Few 'Fillers' (Real Articles) in Between
Engadget writes for bots now, not for humans
Richard Stallman's Talks in Switzerland This Week
We need to put an end to 'cancer culture'; it's trying to kill people and it is even swatting people
Over at Tux Machines...
GNU/Linux news for the past day
IRC Proceedings: Thursday, March 28, 2024
IRC logs for Thursday, March 28, 2024
[Meme] EPO's New Ways of Working (NWoW), a.k.a. You Don't Even Get a Desk at Work and Cannot be Near Known Colleagues
Seems more like union-busting (divide and rule)
Hiding Microsoft's Culpability in Security Breaches and Other Major Blunders (in the United Kingdom, This May Mean You Can't Get Food)
Total Cost of Ownership (TCO) is vast
Giving back to the community
Reprinted with permission from Daniel Pocock
Links 28/03/2024: Sega, Nintendo, and Bell Layoffs
Links for the day
Open letter to the ACM regarding Codes of Conduct impersonating the Code of Ethics
Reprinted with permission from Daniel Pocock
With 9 Mentions of Azure In Its Latest Blog Post, Canonical is Again Promoting Microsoft and Intel Vendor Lock-in, Surveillance, Back Doors, Considerable Power Waste, and Defects That Cannot be Fixed
Microsoft did not even have to buy Canonical (for Canonical to act like it happened)
Links 28/03/2024: GAFAM Replacing Full-Time Workers With Interns Now
Links for the day
Consent & Debian's illegitimate constitution
Reprinted with permission from Daniel Pocock
The Time Our Server Host Died in a Car Accident
If Debian has internal problems, then they need to be illuminated and then tackled, at the very least in order to ensure we do not end up with "Deadian"
China's New 'IT' Rules Are a Massive Headache for Microsoft
On the issue of China we're neutral except when it comes to human rights issues
Over at Tux Machines...
GNU/Linux news for the past day
IRC Proceedings: Wednesday, March 27, 2024
IRC logs for Wednesday, March 27, 2024
WeMakeFedora.org: harassment decision, victory for volunteers and Fedora Foundations
Reprinted with permission from Daniel Pocock
Links 27/03/2024: Terrorism Grows in Africa, Unemployment in Finland Rose Sharply in a Year, Chinese Aggression Escalates
Links for the day
Links 27/03/2024: Ericsson and Tencent Layoffs
Links for the day
Amid Online Reports of XBox Sales Collapsing, Mass Layoffs in More Teams, and Windows Making Things Worse (Admission of Losses, Rumours About XBox Canceled as a Hardware Unit)...
Windows has loads of issues, also as a gaming platform
Links 27/03/2024: BBC Resorts to CG Cruft, Akamai Blocking Blunders in Piracy Shield
Links for the day
Android Approaches 90% of the Operating Systems Market in Chad (Windows Down From 99.5% 15 Years Ago to Just 2.5% Right Now)
Windows is down to about 2% on the Web-connected client side as measured by statCounter
Sainsbury's: Let Them Eat Yoghurts (and Microsoft Downtimes When They Need Proper Food)
a social control media 'scandal' this week
IRC Proceedings: Tuesday, March 26, 2024
IRC logs for Tuesday, March 26, 2024
Over at Tux Machines...
GNU/Linux news for the past day
Windows/Client at Microsoft Falling Sharply (Well Over 10% Decline Every Quarter), So For His Next Trick the Ponzi in Chief Merges Units, Spices Everything Up With "AI"
Hiding the steep decline of Windows/Client at Microsoft?
Free technology in housing and construction
Reprinted with permission from Daniel Pocock
We Need Open Standards With Free Software Implementations, Not "Interoperability" Alone
Sadly we're confronting misguided managers and a bunch of clowns trying to herd us all - sometimes without consent - into "clown computing"
Microsoft's Collapse in the Web Server Space Continued This Month
Microsoft is the "2%", just like Windows in some countries