EditorsAbout the SiteComes vs. MicrosoftUsing This Web SiteSite ArchivesCredibility IndexOOXMLOpenDocumentPatentsNovellNews DigestSite NewsRSS

10.23.13

Microsoft Culture Against Another Universal Standard: Unicode

Posted in Standard at 5:31 am by Dr. Roy Schestowitz

Unicode

Summary: Microsoft’s long battle against character encoding standards such as Unicode, which bridge the gap for communication between people, not just applications

HALF A decade ago we spent a lot of time here promoting open standards — the grooves for connectivity between applications, operating systems, and pertinent pieces of code. Without standards, there is little collaboration because the cost of connecting separate pieces of software is quite high.

“But to Microsoft consistency was an evil threat; it threatened its monopoly.”Assuming that collaboration is the key to rapid advancement and innovation — reusing knowledge, pooling human resources, etc. — standards are important everywhere we look, e.g. electrics, plumbing, energy, automobiles and so on. Encoding of characters is not everyone’s field of expertise; it is a low-level area of computing, akin to assembly code and little/big endian. But the principles of standards stay the same across fields and standards are almost always beneficial. I have wasted many hours of my life trying to overcome issue associated with Microsoft’s broken character encodings. It was a long time ago that people appreciated the value of consistency in some areas (not to be confused with monoculture or monopoly). But to Microsoft consistency was an evil threat; it threatened its monopoly. The Scientist published a piece called “Standards Needed” [1] not too long ago and Linux Journal praised Unicode [2], which helps bridge character encoding barriers. Thanks to Unicode, many of us out there can access and render pages in almost any language, even rare languages (and even if we cannot understand them). The Register, however, thought it would be productive to bash Unicode [3]. And watch who wrote the piece: a Windowshead. What a surprise!

Related/contextual items from the news:

  1. Opinion: Standards Needed
  2. Unicode

    Let’s give credit where credit’s due: Unicode is a brilliant invention that makes life easier for millions—even billions—of people on our planet. At the same time, dealing with Unicode, as well as the various encoding systems that preceded it, can be an incredibly painful and frustrating experience. I’ve been dealing with some Unicode-related frustrations of my own in recent days, so I thought this might be a good time to revisit a topic that every modern software developer, and especially every Web developer, should understand.

  3. Down with Unicode! Why 16 bits per character is a right pain in the ASCII

    In the beginning – well, not in the very beginning, obviously, because that would require a proper discussion of issues such as parity and error correction and Hamming distances; and the famous quarrel between the brothers ASCII, ISCII VISCII and YUSCII; and how in the 1980s if you tried to send a £ sign to a strange printer that you had not previously befriended (for example, by buying it a lovely new ribbon) your chances of success were negligible; and, and…

    But you are a busy and important person.

    So in the beginning that began in the limited world of late MS-DOS and early Windows programming, O best beloved, there were these things called “code pages”.

    To the idle anglophone Windows programmer (ie: me) code pages were something horrible and fussy that one hoped to get away with ignoring. I was dimly aware that, to process strings in some of the squigglier foreign languages, it was necessary to switch code page and sometimes, blimey, use two bytes per character instead of just one. It was bad enough that They couldn’t decide how many characters it took to mark the end of a line.

    [...]

    As far as I know, there isn’t a creation myth associated with the unification of the world’s character sets.

    [...]

    For Windows C++ programmers, the manifesto identifies specific techniques to make one’s core code UTF-8 based, including a proto-Boost library designed for the purpose. (Ironically, the first thing you have to do is turn the Unicode switch in the Visual C++ compiler to ‘on’.)

    [...]

    Next weekend I will be scraping all my Unicode files off my hard disk, taking them to the bottom of the garden, and burning them. As good citizens of the digital world, I urge you all to do the same.

Share this post: These icons link to social bookmarking sites where readers can share and discover new web pages.
  • Digg
  • del.icio.us
  • Reddit
  • co.mments
  • DZone
  • email
  • Google Bookmarks
  • LinkedIn
  • NewsVine
  • Print
  • Technorati
  • TwitThis
  • Facebook

If you liked this post, consider subscribing to the RSS feed or join us now at the IRC channels.

Pages that cross-reference this one

A Single Comment

  1. UndeadPotato said,

    October 23, 2013 at 8:17 am

    Gravatar

    It feels like you did not read the article. From what I understood from my reading of it, it’s arguing that UTF-8 is more expandable and does not depend on a certain number of bytes per character. I admit, I don’t fully understand the technical merits of Unicode vs. UTF-8 vs. UTF-16, etc. but there’s more to the article than what you say here. It seems like a reasonable opinion based on valid arguments.

What Else is New


  1. The United States Has Gotten Over Software Patents

    A roundup of new articles about software patents in the United States, 2 years into the post-Alice era (the US Supreme Court deeming patents on software too abstract to have merit)



  2. More Lies From President Benoît Battistelli and the EPO Crisis Which Continues to Deepen

    The European Patent Office (EPO), collectively speaking, is still wrestling with a Battistelli infiltration (a circle of high-level managers) which habitually lies and viciously attacks those who dare counter these lies



  3. Links 27/8/2016: Torvalds and GPL, “DOD Must Embrace Open-Source Software”

    Links for the day



  4. Links 26/8/2016: Maru OS Resurfaces, Android More Reliable Than 'i' Things, PC-BSD Becomes TrueOS

    Links for the day



  5. Good Job, David Kappos, Says the 'Boss' (IBM)

    Responses to the latest call against Alice (eliminator of many software patents), courtesy of the man from IBM (still paid by IBM) who was responsible for the policy that blindly approved a lot of software patents in the US



  6. Being for Patent Quality or Against Patenting Excess Does Not Make You Anti-Patents

    Like IAM, which tries to portray sceptics and critics of software patents as "anti-patents", IP Watchdog (or Watchtroll as we call it) is 'trolling' the Electronic Frontier Foundation, simply because it expressed an opinion that patent maximalists cannot tolerate



  7. Erosion of Patent Quality Enables Patent Extortion With Large Portfolios of Low Validity Rate

    Revisiting the EPO's vision of poor patent examination and the effect of discriminatory granting practices, favouring patent bullies such as Microsoft (which actively attacks Linux using low-quality and usually pure software patents)



  8. The EPO's Francesco Zaccà Presenting in Turin Alongside Patent Trolls (Like the Patent Mafia Sisvel) and Lobbyists/Front Groups for Software Patents, UPC

    Benjamin Henrion (FFII) on seeing the EPO alongside patent trolls and other nefarious actors, doing what they do best, which is undermining public interests and harming patent quality



  9. The EPO, USPTO, and Patent Microcosm Peddle Myths About Patents in Public Universities and Research

    Tackling some of the commonly-spread myths about patents as "saving lives" and "promoting research" (in practice leading to the death of poor people and promoting trolls)



  10. Large Corporations' Lobbyist David Kappos Disgraces Former Employer USPTO by Meddling in Their Affairs on Software Patents, Downplaying the Supreme Court

    The latest lobbying from David Kappos, who blatantly exploits his connections in patent circles to promote software patents and work towards their resurgence after Alice v CLS Bank



  11. Journal of Intellectual Property Law and Practice Calls the European Patent Office “Rotten”, Other Sources Scrutinise Recent Moves

    The patent office which was once known for being the best bar none is rotting under the Frenchman Benoît Battistelli, who made himself and his friends the main clients of the Office



  12. PTAB Emerges as Hero of USPTO Because Quality of Patents Improves, Software Patents Are Effectively Dead (or Dying Once Reassessed)

    With help from the Patent Trial and Appeal Board (PTAB) -- not just patent courts -- software patents drop like flies by the thousands



  13. Creative Technology, Now Operating in 'Patent Troll' Mode, Shot Down by the ITC; Jawbone Too Shot Down

    Some good news from the U.S. International Trade Commission (ITC), which may have put an end to Creative's new war on Android (using old patents)



  14. Corporate Media in India Misrepresents Startups to Push for Software Patents

    A parade of misinformation as seen in Indian (but English-speaking) press this week as questions about patentability of software resurface



  15. Links 25/8/2016: Linux Turns 25, NetworkManager Turns 1.4

    Links for the day



  16. Links 24/8/2016: More From LinuxCon, Uganda Wants FOSS

    Links for the day



  17. Links 23/8/2016: GNOME 3.22 Beta, Android 7.0 Nougat

    Links for the day



  18. The Linux Foundation Gives Microsoft (Paid-for) Keynote Position While Microsoft Extorts (With Patents) Lenovo and Motorola Over Linux Use

    This morning's reminder that Nadella is just another Ballmer (with a different face); Motorola and Lenovo surrender to Microsoft's patent demands and will soon put Microsoft spyware/malware on their Linux-powered products to avert costly legal battles



  19. Not Just President Battistelli: EPO Vice-Presidents Are Still Intentionally Misrepresenting EPO Staff

    Evidence serving to show that EPO Vice-Presidents are still intentionally misrepresenting EPO staff representatives and misleading everyone in order to defend Battistelli



  20. Battistelli the Liar Causes a Climate of Confrontation in French Politics, Lies About Patent Quality (Among Many Other Things)

    Battistelli's lies are coming under increased scrutiny inside and outside the European Patent Office (EPO), where patent quality has been abandoned in order to artificially elevate figures



  21. The Collapse of Software Patents and Patent Law Firms Trying to “Overcome” Alice

    The United States continues its gradual crackdown on software patents (which are viewed as abstract and thus unpatentable), whereas in Europe things are murkier than ever



  22. Apple's Patent Wars Against Android/Linux Make Patent Trolls Stronger

    Apple's insistence that designs should be patentable could prove to be collectively expensive, as patent trolls would then use a possible SCOTUS nod to launch litigation campaigns



  23. Links 22/8/2016: Linux 4.8 RC3, Linux Mint 18 “Sarah” KDE Beta

    Links for the day



  24. Links 21/8/2016: Apple and Microsoft Down, Systemd Spreading to Mount

    Links for the day



  25. Links 20/8/2016: Android Domination, FSFE summit 2016

    Links for the day



  26. Patents Roundup: Trolls Dominate Litigation, PTAB Crushes Patents, Patent Box Regime Persists, and OIN Explains Itself

    Another roundup of patent news from around the Web with special focus on software patenting



  27. The Cost/Toll of the 'New' EPO and Where All That Money Goes or Comes From

    The European Patent Office has become a servant of the rich and powerful (including large foreign corporations) and even its own employees now pay the price associated with misguided new policies (or 'reforms' as Battistelli habitually refers to these)



  28. Links 19/8/2016: Linux Mint With KDE, Linux Foundation's PNDA

    Links for the day



  29. The End of an Era at the USPTO as Battistelli-Like (EPO) Granting Policies Are Over

    The United States is seeing the potency of patents -- especially software patents (which make up much of the country's troll cases) -- challenged by courts and by the Patent Trial and Appeal Board (PTAB)



  30. Battistelli's European Patent Office Goes to the United States to Speak About the UPC and Software Patents

    The European Patent Office is showing its utter contempt -- not just disregard -- for the very fundamental rules that put it in its place and brought it into existence


CoPilotCo

RSS 64x64RSS Feed: subscribe to the RSS feed for regular updates

Home iconSite Wiki: You can improve this site by helping the extension of the site's content

Home iconSite Home: Background about the site and some key features in the front page

Chat iconIRC Channel: Come and chat with us in real time

CoPilotCo

Recent Posts