EditorsAbout the SiteComes vs. MicrosoftUsing This Web SiteSite ArchivesCredibility IndexOOXMLOpenDocumentPatentsNovellNews DigestSite NewsRSS


Microsoft Culture Against Another Universal Standard: Unicode

Posted in Standard at 5:31 am by Dr. Roy Schestowitz


Summary: Microsoft’s long battle against character encoding standards such as Unicode, which bridge the gap for communication between people, not just applications

HALF A decade ago we spent a lot of time here promoting open standards — the grooves for connectivity between applications, operating systems, and pertinent pieces of code. Without standards, there is little collaboration because the cost of connecting separate pieces of software is quite high.

“But to Microsoft consistency was an evil threat; it threatened its monopoly.”Assuming that collaboration is the key to rapid advancement and innovation — reusing knowledge, pooling human resources, etc. — standards are important everywhere we look, e.g. electrics, plumbing, energy, automobiles and so on. Encoding of characters is not everyone’s field of expertise; it is a low-level area of computing, akin to assembly code and little/big endian. But the principles of standards stay the same across fields and standards are almost always beneficial. I have wasted many hours of my life trying to overcome issue associated with Microsoft’s broken character encodings. It was a long time ago that people appreciated the value of consistency in some areas (not to be confused with monoculture or monopoly). But to Microsoft consistency was an evil threat; it threatened its monopoly. The Scientist published a piece called “Standards Needed” [1] not too long ago and Linux Journal praised Unicode [2], which helps bridge character encoding barriers. Thanks to Unicode, many of us out there can access and render pages in almost any language, even rare languages (and even if we cannot understand them). The Register, however, thought it would be productive to bash Unicode [3]. And watch who wrote the piece: a Windowshead. What a surprise!

Related/contextual items from the news:

  1. Opinion: Standards Needed
  2. Unicode

    Let’s give credit where credit’s due: Unicode is a brilliant invention that makes life easier for millions—even billions—of people on our planet. At the same time, dealing with Unicode, as well as the various encoding systems that preceded it, can be an incredibly painful and frustrating experience. I’ve been dealing with some Unicode-related frustrations of my own in recent days, so I thought this might be a good time to revisit a topic that every modern software developer, and especially every Web developer, should understand.

  3. Down with Unicode! Why 16 bits per character is a right pain in the ASCII

    In the beginning – well, not in the very beginning, obviously, because that would require a proper discussion of issues such as parity and error correction and Hamming distances; and the famous quarrel between the brothers ASCII, ISCII VISCII and YUSCII; and how in the 1980s if you tried to send a £ sign to a strange printer that you had not previously befriended (for example, by buying it a lovely new ribbon) your chances of success were negligible; and, and…

    But you are a busy and important person.

    So in the beginning that began in the limited world of late MS-DOS and early Windows programming, O best beloved, there were these things called “code pages”.

    To the idle anglophone Windows programmer (ie: me) code pages were something horrible and fussy that one hoped to get away with ignoring. I was dimly aware that, to process strings in some of the squigglier foreign languages, it was necessary to switch code page and sometimes, blimey, use two bytes per character instead of just one. It was bad enough that They couldn’t decide how many characters it took to mark the end of a line.


    As far as I know, there isn’t a creation myth associated with the unification of the world’s character sets.


    For Windows C++ programmers, the manifesto identifies specific techniques to make one’s core code UTF-8 based, including a proto-Boost library designed for the purpose. (Ironically, the first thing you have to do is turn the Unicode switch in the Visual C++ compiler to ‘on’.)


    Next weekend I will be scraping all my Unicode files off my hard disk, taking them to the bottom of the garden, and burning them. As good citizens of the digital world, I urge you all to do the same.

Share this post: These icons link to social bookmarking sites where readers can share and discover new web pages.
  • Digg
  • del.icio.us
  • Reddit
  • co.mments
  • DZone
  • email
  • Google Bookmarks
  • LinkedIn
  • NewsVine
  • Print
  • Technorati
  • TwitThis
  • Facebook

If you liked this post, consider subscribing to the RSS feed or join us now at the IRC channels.

Pages that cross-reference this one

A Single Comment

  1. UndeadPotato said,

    October 23, 2013 at 8:17 am


    It feels like you did not read the article. From what I understood from my reading of it, it’s arguing that UTF-8 is more expandable and does not depend on a certain number of bytes per character. I admit, I don’t fully understand the technical merits of Unicode vs. UTF-8 vs. UTF-16, etc. but there’s more to the article than what you say here. It seems like a reasonable opinion based on valid arguments.

What Else is New

  1. Links 23/10/2016: Alcatel's New Android Smartphones, Another Honorary Doctorate for Stallman

    Links for the day

  2. Open Letter Exposing the Farce Which Was Battistelli's 'Social Conference' Coinciding With Further (New) Attacks on EPO Staff Representatives

    A detailed letter reveals legitimate concerns expressed by staff representatives at the EPO ahead of the so-called Social Conference, in which we have highlighted severe factual flaws

  3. Translation of Latest Rant From French MP Philip Cordery About Benoît Battistelli's Abuses at the EPO

    Philip Cordery crosses horns with Benoît Battistelli, who has become a source of embarrassment for France with his autocratic tendencies and misguided policies that rapidly ruin the European Patent Office (EPO)

  4. Battistelli-Commissioned PwC ‘Study’: Leaked Document Shows PwC's Dishonesty and Misrepresentation of EPO Staff

    An in-depth analysis (but not comprehensive, just preliminary) of the so-called 'study' from PwC, which basically did what it was paid for (pay to say)

  5. Links 22/10/2016: Deus Ex for GNU/Linux, Global DDoS (DNS)

    Links for the day

  6. Battistelli-Commissioned PwC ‘Study’: Survey Comparison Shows Serious Deterioration and Efforts by PwC to Disguise the Truth

    The latest output from PwC turns out to be even worse than initially thought, indicating that not only did it find a degradation in the EPO but also attempted to hide/obscure it

  7. EPO Teaser - The "Iberian Connection" - Some Photos of García-Escudero and His Royal/Government Connections

    A look at the undeniably close connections between Mr. García-Escudero and the most powerful people in Spain

  8. Disruption to Site's Service

    A technical note about why Techrights has not been publishing many articles recently

  9. Links 21/10/2016: MPV 0.21, Mad Max for GNU/Linux

    Links for the day

  10. EPO Caricature: Battistelli's High Five

    Another cartoon about the sad state of the EPO

  11. Battistelli Ruins Not Only the EPO But Also the Whole of Europe By Ushering in Software Patents That Patent Trolls Love So Much

    Battistelli's bad leadership at the EPO threatens to bring to Europe all the ills and menaces of the patent system in the United States

  12. EPO Spokesman Lies to IP Watch in Order to Save Face and Save the King (Battistelli)

    Rewriting history (revisionism) regarding Battistelli and what was demanded amidst abusive behaviour from him

  13. Unitary Patent (UPC) is Dead, But 'Managing IP' and Selfish Patent Law Firms Still Try to Resurrect It

    The latest attempts to shore up the Unitary (or Unified) Patent Court and who's behind it other than the usual suspects

  14. Links 20/10/2016: Linux 4.10 Preview, ONF and ON.Labs to Merge

    Links for the day

  15. Battistelli-Commissioned PwC 'Study': The Raw Outcome Shows Distortion of the Facts at the EPO's Notorious 'Social Conference'

    Results of the Staff Survey carried out by PwC, in order to provide some propaganda for Battistelli's expensive Social Conference

  16. Addendum: EPO's Alberto Casado Cerviño, WIPO's Francis Gurry, and EUIPO's Archambeau

    Photos taken as part of an IP event which took place in Riga (Latvia) in March 2015

  17. Worrisome Connections Between EPO VP2 Alberto Casado Cerviño and Patricia García-Escudero Márquez

    Exploring the potential conflicts of interests implicating the EPO's Boards of Appeal Committee

  18. Site's Infrastructure Under Attack and Upgrades Ahead of Major New Publications

    Protections for the Web site have been improved and capacity increased in order to avoid or at least prepare for another week of abusive/spam traffic

  19. Team Battistelli's Conspiracy Theory: SUEPO is Behind Everything, EPO Management is Trying to Tell the Media

    Attempts to blame SUEPO, the staff union of the EPO, even though SUEPO has nothing to do with articles that are critical of the EPO while many thousands of EPO employees are disgruntled

  20. Links 19/10/2016: Canonical Livepatch Service, Plasma Plans

    Links for the day

  21. The 'Sarah Sharps' of Microsoft: Not the Kind of Scandal the Media Cares Enough to Write About

    Another example of the large (industrial) scale of sexual discrimination at Microsoft -- a company that tries to advertise itself as diverse or tolerant and stigmatise Free/Open Source software (FOSS) as intolerant and/or not diverse

  22. EPO Caricature: EQE Questions

    The latest EPO cartoon, this time about European qualifying examination (EQE)

  23. The Long History or Seeds of Control by Fear and Punishment at the EPO

    The latest hogwash from Team Battistelli (Pinocchio), the latest instance of software patents promotion by EPO Principal Director, and an old (decade-old) nugget of information from the Forum for Principal Directors

  24. Subject of the European Patent Office's Abuses Raised in European Parliament by Ulrike Müller (ALDE)

    A local copy of a bunch of questions asked less than a month ago by Ulrike Müller at the European Parliament, regarding the unacceptable state of affairs at the European Patent Office (EPO)

  25. French Article About the EPO "Crisis"

    Le Monde, which covered EPO suicides and nervous breakdowns a year and a half ago, revisits the subject

  26. Battistelli Wants Us to Believe a Patent Office in a Freefall (EPO) is “Stronger and More Sustainable”

    Still in denial (or self-deluding for self indulgence), Battistelli writes about the EPO as though everything is rosy and people are happy

  27. Leaked Documents Shed More Light on What Happened to Alison Brimelow and How Battistelli Rose to Power

    How Battistelli's (almost) all-male (and all-white, mostly French) management came into being, not too long after Ms Alison Brimelow got elbowed out the Office

  28. Leaked: Outcomes of 149th Administrative Council's Meeting at the European Patent Organisation

    The raw details or a summary thereof, based on the above which serves to confirm what we wrote about several days ago, right after the quarterly meeting had ended

  29. Danish Press Coverage of the European Patent Office and the Problems Explored by Techrights

    Jesper Kongstad does virtually nothing to deny the arguments (or "accusations") and instead alludes to the style of the writings about him

  30. Links 18/10/2016: Release Candidate of Leap 42.2, Looking Ahead at GTK4

    Links for the day


RSS 64x64RSS Feed: subscribe to the RSS feed for regular updates

Home iconSite Wiki: You can improve this site by helping the extension of the site's content

Home iconSite Home: Background about the site and some key features in the front page

Chat iconIRC Channel: Come and chat with us in real time


Recent Posts