EditorsAbout the SiteComes vs. MicrosoftUsing This Web SiteSite ArchivesCredibility IndexOOXMLOpenDocumentPatentsNovellNews DigestSite NewsRSS

10.23.13

Microsoft Culture Against Another Universal Standard: Unicode

Posted in Standard at 5:31 am by Dr. Roy Schestowitz

Unicode

Summary: Microsoft’s long battle against character encoding standards such as Unicode, which bridge the gap for communication between people, not just applications

HALF A decade ago we spent a lot of time here promoting open standards — the grooves for connectivity between applications, operating systems, and pertinent pieces of code. Without standards, there is little collaboration because the cost of connecting separate pieces of software is quite high.

“But to Microsoft consistency was an evil threat; it threatened its monopoly.”Assuming that collaboration is the key to rapid advancement and innovation — reusing knowledge, pooling human resources, etc. — standards are important everywhere we look, e.g. electrics, plumbing, energy, automobiles and so on. Encoding of characters is not everyone’s field of expertise; it is a low-level area of computing, akin to assembly code and little/big endian. But the principles of standards stay the same across fields and standards are almost always beneficial. I have wasted many hours of my life trying to overcome issue associated with Microsoft’s broken character encodings. It was a long time ago that people appreciated the value of consistency in some areas (not to be confused with monoculture or monopoly). But to Microsoft consistency was an evil threat; it threatened its monopoly. The Scientist published a piece called “Standards Needed” [1] not too long ago and Linux Journal praised Unicode [2], which helps bridge character encoding barriers. Thanks to Unicode, many of us out there can access and render pages in almost any language, even rare languages (and even if we cannot understand them). The Register, however, thought it would be productive to bash Unicode [3]. And watch who wrote the piece: a Windowshead. What a surprise!

Related/contextual items from the news:

  1. Opinion: Standards Needed
  2. Unicode

    Let’s give credit where credit’s due: Unicode is a brilliant invention that makes life easier for millions—even billions—of people on our planet. At the same time, dealing with Unicode, as well as the various encoding systems that preceded it, can be an incredibly painful and frustrating experience. I’ve been dealing with some Unicode-related frustrations of my own in recent days, so I thought this might be a good time to revisit a topic that every modern software developer, and especially every Web developer, should understand.

  3. Down with Unicode! Why 16 bits per character is a right pain in the ASCII

    In the beginning – well, not in the very beginning, obviously, because that would require a proper discussion of issues such as parity and error correction and Hamming distances; and the famous quarrel between the brothers ASCII, ISCII VISCII and YUSCII; and how in the 1980s if you tried to send a £ sign to a strange printer that you had not previously befriended (for example, by buying it a lovely new ribbon) your chances of success were negligible; and, and…

    But you are a busy and important person.

    So in the beginning that began in the limited world of late MS-DOS and early Windows programming, O best beloved, there were these things called “code pages”.

    To the idle anglophone Windows programmer (ie: me) code pages were something horrible and fussy that one hoped to get away with ignoring. I was dimly aware that, to process strings in some of the squigglier foreign languages, it was necessary to switch code page and sometimes, blimey, use two bytes per character instead of just one. It was bad enough that They couldn’t decide how many characters it took to mark the end of a line.

    [...]

    As far as I know, there isn’t a creation myth associated with the unification of the world’s character sets.

    [...]

    For Windows C++ programmers, the manifesto identifies specific techniques to make one’s core code UTF-8 based, including a proto-Boost library designed for the purpose. (Ironically, the first thing you have to do is turn the Unicode switch in the Visual C++ compiler to ‘on’.)

    [...]

    Next weekend I will be scraping all my Unicode files off my hard disk, taking them to the bottom of the garden, and burning them. As good citizens of the digital world, I urge you all to do the same.

Share this post: These icons link to social bookmarking sites where readers can share and discover new web pages.
  • Digg
  • del.icio.us
  • Reddit
  • co.mments
  • DZone
  • email
  • Google Bookmarks
  • LinkedIn
  • NewsVine
  • Print
  • Technorati
  • TwitThis
  • Facebook

If you liked this post, consider subscribing to the RSS feed or join us now at the IRC channels.

Pages that cross-reference this one

A Single Comment

  1. UndeadPotato said,

    October 23, 2013 at 8:17 am

    Gravatar

    It feels like you did not read the article. From what I understood from my reading of it, it’s arguing that UTF-8 is more expandable and does not depend on a certain number of bytes per character. I admit, I don’t fully understand the technical merits of Unicode vs. UTF-8 vs. UTF-16, etc. but there’s more to the article than what you say here. It seems like a reasonable opinion based on valid arguments.

What Else is New


  1. Links 27/2/2017: GNU Linux-libre 4.10, Weston 2.0.0, Git 2.12.0, Linux From Scratch 8.0

    Links for the day



  2. Top Officials in French Government Are Growing Tired of Battistelli's Abuses at the European Patent Office (EPO)

    An automated translation of a recent debate about the EPO in the French government, culminating in intervention by Richard Yung



  3. A US Supreme Court (SCOTUS) Which is Hostile Towards Patent Maximalists May Closely Examine More Patents That Apple Uses Against Android

    A company which often takes pride in designers rather than developers (art, not technical merit) may lose that leverage over the competition if its questionable patents are taken away by the Supremes



  4. As Long as Software Patents Are Granted and Microsoft Equips Trolls With Them, “Azure IP Advantage” is an Attack on Free/Libre Software

    Microsoft is feeding enemies of GNU/Linux and Free/libre Open Source software (FLOSS) in order to sell its 'protection', which it names "IP Advantage" in a rather Orwellian fashion (same naming as back in the Novell days)



  5. Patent Trolls on Their Way Out in the United States and Their Way Into China, No Thanks to the Open Invention Network (OIN)

    An update on patent trolls and the role played by supposed allies of Free/libre software, who in practice do everything to exacerbate the problem rather than resolve it



  6. Insensitivity at the EPO’s Management – Part VIII: When Governed by Criminals, Truth-Tellers Are Cast as Criminals and Criminals as Justice Deliverers

    The bizarre state of affairs at the European Patent Office, where being an honest and transparent person makes one incredibly vulnerable and subjected to constant harassment from the management



  7. The Sickness of the EPO – Part V: Shedding Light on Institutional Abuse Against Ill and/or Disabled Individuals

    The seriousness of the situation at the EPO and a call for action, which requires greater transparency, even if imposed transparency



  8. The EPO's Race to the Bottom in Recruitment and Early Retirements Explained by an Insider

    The European Patent Office under Battistelli is failing to attract -- and certainly failing to retain -- talented examiners



  9. Wouter Pors and Other UPC Boosters Believe That Repeating the Lies Will Potentially Make Them Truths

    The lobbying campaign for UPC, or hopeful lies (sometimes mere rumours) disguised as "news", continues to rely on false perceptions that the UPC is just a matter of time and may actually materialise this year



  10. The Patent Trial and Appeal Board (PTAB) is Utilised in Fixing the US Patent System and the Patent Microcosm Loses Its Mind

    A roundup of PTAB news, ranging from attacks on the legitimacy of PTAB to progress which is made by PTAB, undoing decades of overpatenting



  11. The Patent Trial and Appeal Board (PTAB) and the Federal Circuit (CAFC) Take on Patents Pertaining to Business Methods

    Patents on tasks that can be performed using pen and paper (so-called 'business methods', just like algorithms) and oughtn't be patent-eligible may be the next casualty of the America Invents Act (AIA)



  12. Google's Stewardship of GNU/Linux (Android, Chromebooks and More) in Doubt After Company Resorts to Patent 'First Strikes'

    Google has just turned a little more evil, by essentially using patents as a weapon against the competition (by no means a defensive move)



  13. Links 24/2/2017: Ubuntu 17.04 Beta, OpenBSD Foundation Nets $573,000 in Donations

    Links for the day



  14. IAM, Greased up by the EPO, Continues Lobbying by Shaming Tactics for the UPC, Under the Guise of 'News'

    The shrill and well-paid writers of IAM are still at it, promoting the Unitary Patent (UPC) at every opportunity and every turn



  15. Patent Scope Gone Awry: European Vegetable Patents Office?

    In its misguided race to raise so-called 'production', the EPO lost sight of its original goals and now facilitates patent royalty payments/taxation for naturally-recurring items of nature



  16. Yes, There is Definitely Brain Drain (Experience Deficit) at the European Patent Office and Stakeholders Feel It

    The direction that the European Patent Office has taken under Battistelli undoes many decades (almost half a century) of reputation-building and progress and naturally this repels existing staff, not to mention hampers recruitment efforts



  17. The Sickness of the EPO – Part IV: Cruel Management That Deliberately Attacks the Sick and the Weak

    The dysphoric reality at the European Patent Office, which is becoming like a large cell (with bolted-down windows) where people are controlled by fear and scapegoats are selected to perpetuate this atmosphere of terror and maintain demand (or workload) for the Investigative Stasi



  18. Links 23/2/2017: Qt 5.9 Alpha, First SHA1 Collision

    Links for the day



  19. UPC Roundup: War on the Appeal Boards, British Motion Against the UPC, Fröhlinger Recalled, and Fake News About Spain

    Taking stock of some of the latest attempts to shove the Unitary Patent (UPC) down Europe's throat, courtesy of Team Battistelli and Team UPC



  20. The Sickness of the EPO – Part III: Invalidity and Suicides

    An explanation of what drives a lot of EPO veterans to depression and sometimes even suicide



  21. The Appeal Board (PTAB) and Federal Circuit (CAFC) Maintain Good Pace of Patent Elimination Where Scope Was Exceeded

    The Court of Appeals for the Federal Circuit (CAFC) continues to accept about 4 out of 5 decisions of the Patent Trial and Appeal Board (PTAB) and the US Supreme Court (SCOTUS) refuses to intervene



  22. Software Patents Are Ebbing Away, But the “Swamp” Fights Back and Hijacks the Word “Fix”

    The club of patent maximalists, or those who profit from excess prosecution and legal chaos, isn't liking what has happened in the United States and it wants everything reversed



  23. Report From Yesterday's Debate About the European Patent Office (EPO) at the Bavarian Landtag

    A report of the EPO debate which took place at the Bavarian Landtag yesterday (21/2/2017)



  24. Links 22/2/2017: Wine-Staging 2.2, Nautilus 3.24

    Links for the day



  25. French Politician Richard Yung Tells the Government About Abuses at the European Patent Office (EPO)

    The subject of EPO scandals has once again landed in French politics, just a couple of months since it last happened



  26. The Sickness of the EPO – Part II: Background Information and Insights

    With a privatised, in-house (sometimes outsourced and for-profit) force for surveillance, policing, justice, public relations and now medical assessment (mere vassals or marionettes of the management) the EPO serves to show that it has become indistinguishable from North Korea, where the Supreme Leader gets to control every single aspect (absolutely no separation of powers)



  27. EPO Cartoon/Caricature by KrewinkelKrijst

    A new rendition by Dutch cartoonist and illustrator KrewinkelKrijst



  28. Inverting Narratives: IAM 'Magazine' Paints Massive Patent Bully Microsoft (Preying on the Weak) as a Defender of the Powerless

    Selective coverage and deliberate misinterpretation of Microsoft's tactics (patent settlement under threat, disguised as "pre-installation of some of the US company’s software products") as seen in IAM almost every week these days



  29. The Sickness of the EPO – Part I: Motivation for New Series of Articles

    An introduction or prelude to a long series of upcoming posts, whose purpose is to show governance by coercion, pressure, retribution and tribalism rather than professional relationship between human beings at the European Patent Office (EPO)



  30. Insensitivity at the EPO’s Management – Part VII: EPO Hypocrisy on Cancer and Lack of Feedback to and From ECPC

    The European Cancer Patient Coalition (ECPC), which calls itself "the largest European cancer patients' umbrella organisation," fails to fulfill its duties, says a source of ours, and the EPO makes things even worse


CoPilotCo

RSS 64x64RSS Feed: subscribe to the RSS feed for regular updates

Home iconSite Wiki: You can improve this site by helping the extension of the site's content

Home iconSite Home: Background about the site and some key features in the front page

Chat iconIRC Channel: Come and chat with us in real time

CoPilotCo

Recent Posts