Bonum Certa Men Certa

Microsoft Culture Against Another Universal Standard: Unicode

Unicode



Summary: Microsoft's long battle against character encoding standards such as Unicode, which bridge the gap for communication between people, not just applications

HALF A decade ago we spent a lot of time here promoting open standards -- the grooves for connectivity between applications, operating systems, and pertinent pieces of code. Without standards, there is little collaboration because the cost of connecting separate pieces of software is quite high.



"But to Microsoft consistency was an evil threat; it threatened its monopoly."Assuming that collaboration is the key to rapid advancement and innovation -- reusing knowledge, pooling human resources, etc. -- standards are important everywhere we look, e.g. electrics, plumbing, energy, automobiles and so on. Encoding of characters is not everyone's field of expertise; it is a low-level area of computing, akin to assembly code and little/big endian. But the principles of standards stay the same across fields and standards are almost always beneficial. I have wasted many hours of my life trying to overcome issue associated with Microsoft's broken character encodings. It was a long time ago that people appreciated the value of consistency in some areas (not to be confused with monoculture or monopoly). But to Microsoft consistency was an evil threat; it threatened its monopoly. The Scientist published a piece called "Standards Needed" [1] not too long ago and Linux Journal praised Unicode [2], which helps bridge character encoding barriers. Thanks to Unicode, many of us out there can access and render pages in almost any language, even rare languages (and even if we cannot understand them). The Register, however, thought it would be productive to bash Unicode [3]. And watch who wrote the piece: a Windowshead. What a surprise!

Related/contextual items from the news:



  1. Opinion: Standards Needed


  2. Unicode
    Let's give credit where credit's due: Unicode is a brilliant invention that makes life easier for millions—even billions—of people on our planet. At the same time, dealing with Unicode, as well as the various encoding systems that preceded it, can be an incredibly painful and frustrating experience. I've been dealing with some Unicode-related frustrations of my own in recent days, so I thought this might be a good time to revisit a topic that every modern software developer, and especially every Web developer, should understand.


  3. Down with Unicode! Why 16 bits per character is a right pain in the ASCII
    In the beginning - well, not in the very beginning, obviously, because that would require a proper discussion of issues such as parity and error correction and Hamming distances; and the famous quarrel between the brothers ASCII, ISCII VISCII and YUSCII; and how in the 1980s if you tried to send a €£ sign to a strange printer that you had not previously befriended (for example, by buying it a lovely new ribbon) your chances of success were negligible; and, and...

    But you are a busy and important person.

    So in the beginning that began in the limited world of late MS-DOS and early Windows programming, O best beloved, there were these things called "code pages".

    To the idle anglophone Windows programmer (ie: me) code pages were something horrible and fussy that one hoped to get away with ignoring. I was dimly aware that, to process strings in some of the squigglier foreign languages, it was necessary to switch code page and sometimes, blimey, use two bytes per character instead of just one. It was bad enough that They couldn't decide how many characters it took to mark the end of a line.

    [...]

    As far as I know, there isn't a creation myth associated with the unification of the world's character sets.

    [...]

    For Windows C++ programmers, the manifesto identifies specific techniques to make one's core code UTF-8 based, including a proto-Boost library designed for the purpose. (Ironically, the first thing you have to do is turn the Unicode switch in the Visual C++ compiler to 'on'.)

    [...]

    Next weekend I will be scraping all my Unicode files off my hard disk, taking them to the bottom of the garden, and burning them. As good citizens of the digital world, I urge you all to do the same.


Comments

Recent Techrights' Posts

Microsoft Windows Barely Exists in Haiti Anymore
This trend in Haiti is a "story in progress"
Free Speech Around the World is Curtailed in the Name of "Protecting Us"
We have spent many years speaking about how to combat this trend
 
Links 17/03/2025: Weather Changing and Connecting Docker to Localhost
Links for the day
The EPO Might Face Critical 'Brain Drain' (Abandonment by the Most Experienced Patent Examiners) This Year
"a number of colleagues might feel compelled to inform the Administration before the end of May 2025 of their intention to retire as of 1 December 2025."
Links 17/03/2025: Forced Labour and Memory on Tenstorrent
Links for the day
Links 17/03/2025: Live Nation’s DOJ Antitrust Battle Carries on, as Does the Demise of the "Hey Hi" Bubble
Links for the day
Links 17/03/2025: "Badly Misled About Covid" and "Gag of America"
Links for the day
The Lie or Half-Truth of Clownflare (or Equivalents) Improving Things
It may seem "cheap" (temporarily) and "fast", but that's just bait
Enshittification of Online Media
Now more than ever we must fight for independent press
War Readiness Means Removing Every Windows Installation and CALEA-Compliant Equipment
Finland is vulnerable for a whole bunch of reasons
Reporting Facts is Not a Privacy Violation
Techrights has long valued and defended privacy
In the Russian Federation (Russia), Microsoft Isn't Even the 1%
the government builds "homegrown" (not pertinent parts of them) distros with which to replace Microsoft, not just Windows
Gemini Links 17/03/2025: "Hack the Planet", Klingnauer Stausee, and Enshittification
Links for the day
Over at Tux Machines...
GNU/Linux news for the past day
IRC Proceedings: Sunday, March 16, 2025
IRC logs for Sunday, March 16, 2025
Slow News Cycles Are Part of a Trend, Technology Gravitating Towards Rich People's Interests
This issue isn't limited to the Web
Recent Site Changes and Looking Towards 2026
In November 2026 we turn 20
Mozilla Firefox is Probably Already Below 2% in the UK (United Kingdom)
LibreWolf identifies as "Firefox" by default
When You Don't Want to Tinker Much You Just Use GNU/Linux, Not Windows
With GNU/Linux upgrades are possible and, failing that, one can just back up the home directory and copy it "back into" the new OS
Facebook REALLY, REALLY, R E A L L Y Does Not Want You to Read This Book
It would be a CRIME to read it
Coming Soon, the Next Chapter About the Crisis of the Open Source Initiative (OSI)
We're far from done
Illuminating Microsoft's Code of Conduct (CoC) Hypocrisy
Oppressor victimhood? Leadership claimed by the worst offenders?
Planet Ubuntu - or Ubuntu Planet - Has an LLM Slop Problem (Called Faizul "Piju" 9M2PJU)
Does investigative reporting have any future at all?
Links 16/03/2025: Handwriting Comeback and "MElon’s Attack on U.S.A.I.D."
Links for the day
Gemini Links 16/03/2025: "Differences Distance" and "Dopamine-addicted Pigeon"
Links for the day
Expect GNU/Linux to Rise Sharply in China
But Red China won't trust Red Hat (IBM), which works for the Pentagon and keeps the "secret sauce" for its OS secret (just what Americans accused China of doing with its distros)
Links 16/03/2025: American Press Under Attack, "France Offers to Take in US Scientists"
Links for the day
Gemini Links 16/03/2025: Threats to Canada and How to Process News Online
Links for the day
Links 16/03/2025: Growing Tariff Hostilities and Social Media Surveillance
Links for the day
Over at Tux Machines...
GNU/Linux news for the past day
IRC Proceedings: Saturday, March 15, 2025
IRC logs for Saturday, March 15, 2025
Gemini Links 15/03/2025: Sleeping in March, Headless Raspberry Pi 4
Links for the day
Links 15/03/2025: Hey Hi (AI) Hype Waning, Microsoft and Apple Ridiculed for Vapourware
Links for the day
Many Reports About Microsoft Layoffs Are LLM Slop Based on Other LLM Slop (From Microsoft-controlled LLMs That Downplay the Layoffs or Give Badly Outdated Data)
The LLM slopfarms also dilute/derank actual news about Linux by pushing Microsoft Azure instead; it's a spamfest!
When You Expose Corporate Crimes, Misconduct and Lies They Harasses and Troll You. Then You Write About the Harassment and Trolling and They Allege It's "All Personal".
protect women's safety
Gemini Links 15/03/2025: Bandcamp and DST
Links for the day
Links 15/03/2025: Albania TikTok Ban, No Skinnerboxes in Danish Schools
Links for the day
Sierra Leone: Android Up to Record Highs, Windows Falls to Record Lows of Almost 5% (15 Years Ago It Was 100%)
This is what happens when about 83% of Web requests come from mobile
Margarita Manterola (marga, Google) & Debian DebConf13 Swiss venue intrigue
Reprinted with permission from Daniel Pocock
Over at Tux Machines...
GNU/Linux news for the past day
IRC Proceedings: Friday, March 14, 2025
IRC logs for Friday, March 14, 2025