Bonum Certa Men Certa

Microsoft Culture Against Another Universal Standard: Unicode

Unicode



Summary: Microsoft's long battle against character encoding standards such as Unicode, which bridge the gap for communication between people, not just applications

HALF A decade ago we spent a lot of time here promoting open standards -- the grooves for connectivity between applications, operating systems, and pertinent pieces of code. Without standards, there is little collaboration because the cost of connecting separate pieces of software is quite high.



"But to Microsoft consistency was an evil threat; it threatened its monopoly."Assuming that collaboration is the key to rapid advancement and innovation -- reusing knowledge, pooling human resources, etc. -- standards are important everywhere we look, e.g. electrics, plumbing, energy, automobiles and so on. Encoding of characters is not everyone's field of expertise; it is a low-level area of computing, akin to assembly code and little/big endian. But the principles of standards stay the same across fields and standards are almost always beneficial. I have wasted many hours of my life trying to overcome issue associated with Microsoft's broken character encodings. It was a long time ago that people appreciated the value of consistency in some areas (not to be confused with monoculture or monopoly). But to Microsoft consistency was an evil threat; it threatened its monopoly. The Scientist published a piece called "Standards Needed" [1] not too long ago and Linux Journal praised Unicode [2], which helps bridge character encoding barriers. Thanks to Unicode, many of us out there can access and render pages in almost any language, even rare languages (and even if we cannot understand them). The Register, however, thought it would be productive to bash Unicode [3]. And watch who wrote the piece: a Windowshead. What a surprise!

Related/contextual items from the news:



  1. Opinion: Standards Needed


  2. Unicode
    Let's give credit where credit's due: Unicode is a brilliant invention that makes life easier for millions—even billions—of people on our planet. At the same time, dealing with Unicode, as well as the various encoding systems that preceded it, can be an incredibly painful and frustrating experience. I've been dealing with some Unicode-related frustrations of my own in recent days, so I thought this might be a good time to revisit a topic that every modern software developer, and especially every Web developer, should understand.


  3. Down with Unicode! Why 16 bits per character is a right pain in the ASCII
    In the beginning - well, not in the very beginning, obviously, because that would require a proper discussion of issues such as parity and error correction and Hamming distances; and the famous quarrel between the brothers ASCII, ISCII VISCII and YUSCII; and how in the 1980s if you tried to send a €£ sign to a strange printer that you had not previously befriended (for example, by buying it a lovely new ribbon) your chances of success were negligible; and, and...

    But you are a busy and important person.

    So in the beginning that began in the limited world of late MS-DOS and early Windows programming, O best beloved, there were these things called "code pages".

    To the idle anglophone Windows programmer (ie: me) code pages were something horrible and fussy that one hoped to get away with ignoring. I was dimly aware that, to process strings in some of the squigglier foreign languages, it was necessary to switch code page and sometimes, blimey, use two bytes per character instead of just one. It was bad enough that They couldn't decide how many characters it took to mark the end of a line.

    [...]

    As far as I know, there isn't a creation myth associated with the unification of the world's character sets.

    [...]

    For Windows C++ programmers, the manifesto identifies specific techniques to make one's core code UTF-8 based, including a proto-Boost library designed for the purpose. (Ironically, the first thing you have to do is turn the Unicode switch in the Visual C++ compiler to 'on'.)

    [...]

    Next weekend I will be scraping all my Unicode files off my hard disk, taking them to the bottom of the garden, and burning them. As good citizens of the digital world, I urge you all to do the same.


Comments

Recent Techrights' Posts

'Official' Debian Sites That Sell Proprietary and Surveillance
"Azure API throttling strikes back"
The Latest Microsoft Layoffs Are a Wake-up Call: The Company is Running Low on Money
in most areas it is not even profitable
Software Freedom Month at NITK Surathkal and Yesterday's Talk by Richard Stallman
the message being spread by the person who started it all
Richard Stallman Has Another Talk in India Tomorrow, at Least Fourth India Talk in Recent Days
In the past month he has given at least half a dozen talks
GNU/Linux Reaches All-Time High in the United States, Based on statCounter
Windows is the loser; GNU/Linux grows at its expense
statCounter Reckons Less Than 10% in Mexico Still Use Windows to Access to Web and GNU/Linux Surges to All-Time High (Plus, Microsoft's Latest Debt Crisis)
Looking at Mexico in isolation
 
statCounter Shows "WIntel" Chasing a Dying Market
Microsoft acts as if it's running out of money
Free Software Foundation, Inc. (FSF) Still Raising Money, Richard Stallman Contributes
total exceeding $430k
Just Because People on Top of the Microsoft Pyramid Made a Lot of Money Doesn't Mean Microsoft is Wealthy
The bigger they are the harder they fall
A Lot of Stuff About "Linux" in Google News is LLM Slop, Fake 'Articles'
It seems to be getting worse
Over at Tux Machines...
GNU/Linux news for the past day
IRC Proceedings: Tuesday, February 04, 2025
IRC logs for Tuesday, February 04, 2025
statCounter: Only 1 in ~40 Web Users in Ireland Uses Microsoft Browser, One in Six Uses Windows
When/if Windows market share goes down, so will Edge
Links 04/02/2025: Social Control Media Bans and US Fighting Its Allies, Not Russia
Links for the day
Links 04/02/2025: Birth of a Calf, FOSDEM, and More
Links for the day
Anti-Linux FUD Sites cybersecuritynews.com and gbhackers.com Turn Out to be LLM Slop, Even Plagiarism That Spreads Lies
Beware false headlines and fake text from cybersecuritynews.com and gbhackers.com
BetaNews Began Removing LLM Slop About "Linux", But More of It Keeps Coming From Guardian Digital, Inc (at linuxsecurity.com)
the other Serial Slopper, Guardian Digital, Inc
Mollamby, Suicide Cluster, not trademark, the real reasons for Debian legal expenses, evidence
Reprinted with permission from Daniel Pocock
Links 04/02/2025: Mass Layoffs at Salesforce, Economic Pressures, Trade Wars
Links for the day
[Video] Richard Stallman Auctioning a GNU (Gnu) at Surathkal, India
clip is only a minute-long
statCounter: GNU/Linux and ChromeOS Now Measured at 2.78% in Japan (It Used to be Less Than 0.5%)
really 'took off' half a decade ago
LLM Hype (Chatbots Hyped and Wrongly Characterised as "Artificial Intelligence") Cause Net Inflation
Net as in Internet, not limited to the Web
It Looks Like BetaNews' Managing Editor Wayne Williams is Taking Over From Fagioli After Repeat Pattern of LLM Slop (State-of-the-Art Plagiarism) About "Linux"
The most plausible explanation is, Fagioli got caught or his conduct could no longer be ignored
From India to Italy: Richard Stallman's Next Talk is Next Week in Torino
Announced less than a day ago
Corporate Media is Intentionally Lying for Microsoft, There's Now a Hiring Freeze, No Replacements for Workers Laid Off in Two Mass Layoffs Last Month
Maybe the media - at least some of it - actually deserves doom. If it covers up for the powerful to muzzle and gaslight the oppressed, then what sort of media is that anyway?
Gemini Links 04/02/2025: Tolkien and New Job
Links for the day
Covering EPO Scandals in an Age of Mass Censorship (and Europe Being Afraid to Introspect, for It Might "Help Putin")
It was all along expected that "external enemies" would be invoked to suppress discussion about EPO crimes
Facebook Finally Admits That It Censored Linux and Banned People for Mentioning It; statCounter Shows Rapid Growth for GNU/Linux in Southeast Asia
So GAFAM is losing its power
Over at Tux Machines...
GNU/Linux news for the past day
IRC Proceedings: Monday, February 03, 2025
IRC logs for Monday, February 03, 2025
Links 03/02/2025: Recent Security Holes and Environmentalism
Links for the day
Gemini Links 03/02/2025: X-less English Alphabet and antiX
Links for the day
All Efforts to Censor Techrights Have Always Failed
In 2026 We can make it to 20 years of source protection
Microsoft Bing Lies
When they say "China" or "DeepSeek" censors things don't lose sight of Microsoft
Disappointing 'Results' and Mass Layoffs (Without Severance Pay) Sank Microsoft, But It's a Lot Worse Than Shareholders Care to Realise
People are losing their patience
statCounter: In Web Browsers, Microsoft Collapses to Worst Levels in 2 Years!
Microsoft nowadays insists that it is a "market leader" in a market that does not exist
statCounter: Apple's iOS About to Exceed Windows in Terms of "Market Share" (Despite Windows Being 'Sold' for Less)
Vista 11 is only about 5% of the "market share"
statCounter: GNU/Linux Reaches New All-Time Highs in Brazil and Argentina, Android Has Reached 60% in South America
Microsoft cultivating buzzwords and cult-like thinking, not real products
The Media Does Not Properly Report Microsoft Profits and Losses (It's Partly Intentional)
So how many Vista 11 (preloaded) copies were sold with new PCs?
Links 03/02/2025: Microsoft's Termination Controversy and EU Hey Hi (AI) Act Compliance Day
Links for the day
It Seems Like BetaNews is Finally Deleting Fake 'Articles' About "Linux" by LLM Slop (aka Brian Fagioli)
Is BetaNews finally taking these problems more seriously?
Gemini Links 03/02/2025: Art is Process, Smartphones, Internet, and More
Links for the day
Links 03/02/2025: USAID Under Attack, Vista 11 Breaking Itself Again
Links for the day
Copyleft is the Way to Go (Unless You're an Unpaid Volunteer of GAFAM)
The GPL 'family' of licences is very old and those licences were last revised in 2007
statCounter's Numbers Make Sense Given Microsoft's Falling Windows/Client Revenue
There are already articles (some last week) saying that XBox should just be ended
About 1 in 10 Laptops/Desktops in Venezuela and Cuba Uses GNU/Linux
statCounter says GNU/Linux now exceeds 10% in Cuba
At Microsoft, Promoting Back Doors, Proprietary Lock-in and Mass Surveillance Under the Guise of Diversity ("Microsoft Philanthropy Team")
Microsoft staff enters NGOs to lobby for Microsoft and sell for Microsoft
statCounter: Android Share in Operating Systems, Per Country
Towards the bottom there are poorer countries
Over at Tux Machines...
GNU/Linux news for the past day
IRC Proceedings: Sunday, February 02, 2025
IRC logs for Sunday, February 02, 2025
statCounter: New Record Highs for GNU/Linux in Its Birthplace
So Microsoft is in a tough place
statCounter: In Canada, New Lows for Windows and Bing is Perishing
Windows has fallen to about 60% in desktops/laptops