EditorsAbout the SiteComes vs. MicrosoftUsing This Web SiteSite ArchivesCredibility IndexOOXMLOpenDocumentPatentsNovellNews DigestSite NewsRSS

06.30.09

Microsoft’s Latest Benchmark Fraud

Posted in Database, Deception, Fraud, FUD, GNU/Linux, IBM, Marketing, Microsoft, Oracle, SUN, UNIX at 3:34 am by Dr. Roy Schestowitz

Lie: MS SQL Oracle fake compare

Summary: Microsoft’s advertising is still a scam and should be dealt with appropriately

EARLIER THIS MONTH we wrote about Microsoft coming under threat of lawsuits due to these very same practices. The victim of benchmark fraud was IBM at the time and this time it is Oracle.

One of our readers got us a scan of the advert (see above). “It’s kinda small,” he says, “but you might find it interesting.” Here is the benchmark the advert is mentioning. To quote: “New results from SAP show that on similarly configured systems, SQL Server 2000 running on Windows Server 2003 outperformed Oracle 9i running on HP-UX. The highest Fully Processed Line Items Per hour, 178,000, has SAP certification number 2005017, and the highest 4-way Oracle result in this benchmark is 88,670, with SAP certification number 2004030.

“Such benchmark fraud should be reported to the ASA for deceptive marketing.”They neglect to say that MSSQL server is 8 cores, whereas the Oracle server is 4 cores. Oiaohm adds that “HP-UX has the lowest benchmarks with Oracle. Solaris and Linux outscore it. Basically, Microsoft cheats on benchmarks at every chance. [...] Also thinking Oracle also runs on Windows. Benchmark was very incomplete. [...] Also lower clock speed processors.”

“It’s a really stacked config,” adds the person who sent us this information. “Even with it not being HPUX, you are looking at 4 dual-core Opterons versus 4 single-core Itanium2 processors. Quite a big speed difference too.”

To conclude, he adds: “The point was to show MSSQL was faster than Oracle. They want you to buy their database, not just the OS. It’s just one more effort on Microsoft’s part to spin bad data into a convincing glossy blurb to appeal to the C-levels I don’t mind if they do a fair comparison and win, but this kind of stuff just hurts their credibility.”

Such benchmark fraud should be reported to the ASA for deceptive marketing. This has happened before and the same should be done about “<vendor> recommends Vista” [1, 2] and other marketing schemes, maybe even “it’s better with Windows” [1, 2].

Microsoft keeps wondering why it is not liked in IT circles. It is not because “it’s a big company.”

“Microsoft did sponsor the benchmark testing and the NT server was better tuned than the Linux one. Having said that, I must say that I still trust the Windows NT server would have outperformed the Linux one.”

Windows platform manager, Microsoft South Africa
Reference: Outrage at Microsoft’s independent, yet sponsored NT 4.0/Linux research

Share this post: These icons link to social bookmarking sites where readers can share and discover new web pages.
  • Digg
  • del.icio.us
  • Reddit
  • co.mments
  • DZone
  • email
  • Google Bookmarks
  • LinkedIn
  • NewsVine
  • Print
  • Technorati
  • TwitThis
  • Facebook

If you liked this post, consider subscribing to the RSS feed or join us now at the IRC channels.

Pages that cross-reference this one

2 Comments

  1. Jose_X said,

    June 30, 2009 at 11:47 pm

    Gravatar

    I’ll repeat what I said here for the IBM lawsuit story http://www.eweekeurope.co.uk/news/ibm-goes-legal-over-microsoft-s-websphere-claims-1076
    *****
    Here is a simple recipe.

    Keep in mind this is a hypothetical exercise.

    We have two pieces of hardware: A (ours) and B (theirs).

    We have the corresponding platform software: for A (our platform sw) and for B (their platform sw).

    We have the product being tested on each (in this case, it’s their server software).

    The first step is to make sure we find an A so that it outperforms their B hardware. This is easy to do unless B is the fastest supercomputer on record. It isn’t, obviously, so we can definitely find an A that beats whatever B is. [Eg, a 4gighz x86 beats a 1gighz x86 from the same vendor.]

    Each platform software performs about the same as the other under ordinary circumstances (or maybe ours is a bit worse). This means we will optimize extra for the occasion. This is easy to do by removing security and other tests. We can keep special task/process related memory objects around preinitialized in anticipation. We can simplify and speed up our scheduling. We can give the special process high priority to the CPU and to the filesystem (bypassing security checks, etc). We put everything else, including the GUI, into slow low priority mode. We turn kernel dynamic lists into static lists. Etc. Really, it is possible to optimize well for the occasion if we know the system will only be used for a specific purpose (to win in some benchmark). Also, the platform software we chose for their side is their generic platform software if possible (eg, their regular platform software not optimized for this benchmark).

    So that is how we easily got the improved performance.

    However, we need to control further context in order to pull off the coop. What about the price, right? After all, a supercomputer outperforms a pocket calculator, but people don’t buy supercomputers to compute tax at the restaurant. The context in this case is that the supercomputer is a LOT MORE expensive. We need to get the price of our “supercomputer” down to a competitive level.

    Here is how we carry out this step. We work with the hardware partner. They develop an exclusive model that they will price near cost. We also give away our platform software at near cost (it’s a “special configuration” remember). Voila! We got our costs down because we and our partner have no intention to actually sell many of these models to actual customers.

    So we kick their buttocks, and customers flock to our product.

    Then…

    The hardware model runs out quickly and a very slightly differently named/numbered hardware model is put in its place at a higher price.

    Also, our platform software is changed back to normal, except that now, it actually doesn’t run their server software all that well in comparison to our own server software that competes with theirs (but which was not tested in the benchmark). It’s extremely easy to change platform software bits around so that one app that was favored is no longer favored and is actually handicapped. It’s also very difficult to catch this if third parties don’t have the source code. Also, for subtlety, this change in the platform can be achieved later on through one or more automatic online updates/patches.

    Of course, the price of the platform software also goes up eventually, if not initially. Maybe its price goes up at the one year renewal or else when they exceed an artificially low user count. Or perhaps the price is raised transparently through the bundled software/service package “deal” the customer actually ended up buying. There are many ways to guide them into these higher priced options.

    Profit.

    Recap: We found better hardware, tweaked only our platform software to game the benchmark, and artificially lowered the price on this model in order to win the benchmark price comparison test. Then we switched this system with a regular one, threw in some more items, and modified the platform software (over time) to disfavor their application that we favored for the benchmark. Through this bait and switch we won the contract, and later by controlling the platform software, we disgraced their product to upsell our product in its place. We had the slightly worse software perhaps yet won and pulled in much more money than what they were advertising as their price tag. A full sleigh of hand.

    This is dirty, absolutely. It’s deceptive. It’s anti-consumer and anti-competitive. It likely leverages monopolies later on in the upsell. It is perfectly within Microsoft’s capabilities to pull off. It would be consistent with Microsoft’s past behavior.

    Keep in mind, however, that this was only a hypothetical exercise.

    Jose_X Reply:

    I should point out that the scenarios are different because the stacks are different (in the IBM case, it was the same IBM product that was tested on two different platforms).

    What doesn’t change is the story about deception.. which is also a story about trust.

What Else is New


  1. Links 5/12/2016: SparkyLinux 4.5 Released, Kondik Exits Cyanogen (Destroyed After Microsoft Deal)

    Links for the day



  2. Software Patents Continue Their Invalidation Process, But Patent Law Firms Try to Deny This in Order to Attract Misinformed (or Poorly-Informed) Clients

    A roundup of news about software patents and demonstration of the sheer bias in the media, which is mostly controlled or steered by the patent microcosm rather than actual inventors



  3. Patent Trolls of Microsoft and Ericsson Are Trying to Tax Everything, Especially Linux Devices

    An update on Intellectual Ventures and Unwired Planet, whose operations pose a growing problem for Free software and Linux-based products (e.g. Android)



  4. Asia's Patent Litigation Chaos Getting Worse, Reaching Countries in the West, and Sites Like IAM Actively Promote This

    The race to the bottom (of patent quality) in China, the growth of patent trolls in the region, and the ruinous litigation strategy which now spills over even to the US -- through the Eastern District of Texas -- and may inevitably come to Europe (especially if the UPC ever becomes a reality)



  5. More French Politicians Are Complaining That Benoît Battistelli is a Disgrace to France and Urge for Action

    The backlash against Battistelli spills well outside the EPO and is now apparent even at the French National Assembly



  6. Links 3/12/2016: Mageia 5.1 Released, Mozilla Revenue at $421.3M

    Links for the day



  7. Canadian Intellectual Property Office (CIPO) Sees Decline in Patent Applications and It May Actually be a Good Thing

    Challenging the false belief that the more patents society has the better off it will be, citing examples and news from north America



  8. Blockchain Domain Infested With Software Patents, MasterCard Among the Culprits

    Worrying signs that an area of Free/Open Source software innovation is getting impacted by the plague of software patents



  9. Dutch Media Covers Latest EPO Scandals, German Media Totally Absent (a Media Blackout of Convenience)

    Our observations regarding the apparent media disinterest in EPO scandals, especially at the very core of the EPO (principal host country)



  10. Relocating the Boards of Appeal to Haar is a Poisonous Priority at Battistelli's EPO

    Revisiting Battistelli's effort to chop off the appeal boards that are necessary for ensuring patent quality at the EPO



  11. Links 2/12/2016: Mint Betas, Chrome 55, KDevelop 5.0.3, PHP 7.1.0

    Links for the day



  12. The Rule of Law and Justice Don't Exist Inside the EPO, Confirms the International Labour Organisation (ILO)

    Further analysis of the latest rulings from the ILO -- decisions that were long expected



  13. A Day in the Life of... Battistelli's Banana Republic

    This is part 5 of a fictional diary from the EPO



  14. Links 1/12/2016: Devuan Beta, R3 Liberates Code

    Links for the day



  15. Two ILO Decisions on EPO Cases Are Released, at Least One Judgment is Considered Good for Staff

    Years later (as justice is too slow, partly because of the EPO, being the principal culprit that clogs up the ILO's tribunal system) there is a couple of new judgments about EPO abuses against staff



  16. Dutch and French Politicians Complain About the European Patent Office, British Media Coverage Regular Now

    Pressure from the political systems, the scientific community and from the media is growing, as it becomes abundantly apparent that the EPO cannot go on like this



  17. Links 30/11/2016: Git 2.11, GOG Surprise Tomorrow

    Links for the day



  18. The UPC Scam Part IV: Bumps Along the Road for UPC, With or Without the UK and Brexit

    A sobering reality check regarding the UPC, no matter what Lucy Neville-Rolfe says under pressure from Battistelli and some selfish law firms that are based in London



  19. The UPC Scam Part III: The “Patent Mafia”

    Bigwigs like Lucy Neville-Rolfe and Benoît Battistelli, together with Team UPC and its tiny minority interests (self enrichment), are conspiring to hijack the laws of Europe, doing so across many national borders with unique and locally-steered patent policy in one fell swoop



  20. The UPC Scam Part II: The Patent Echo Chamber at Work, Prematurely Congratulating Itself in Its 'News' Sites





  21. The UPC Scam Part I: EPO-Bribed Media Outlets Lie to Brits (and to Europeans) About the UPC

    An introductory article in a multi-part series about UPC at times of Brexit and Lucy Neville-Rolfe's bizarre sellout to Battistelli



  22. European Public Service Union Asks EPO Administrative Council “to Re-establish the Rule of Law at the European Patent Office”

    The chinchillas of the Administrative Council are assertively asked to tackle the abusive management of the EPO, which gets condemned not only by CERN but also EPSU, which is working with the Dutch government to end lawlessness at the EPO



  23. Links 29/11/2016: Core Apps Hackfest, MuckRock Goes FOSS

    Links for the day



  24. ILOAT Decisions: Upcoming Publication of Two EPO Cases (Abuse Against Staff)

    Reminder about tomorrow's "exceptional public delivery" from the International Labour Organisation (ILO) and a request for additional information



  25. Mixing Politics and EPO: How Battistelli Defies the Very Basic Rules of the Office

    A reminder of the fact that Battistelli was entrenched in French politics even while he was serving at the EPO



  26. EPO DG1 Principal Director “Out of the Muppet Show”

    The ridicule of EPO management is a symptom of a poisonous work environment which now resembles an assembly line of bad patents, where employees are treated unfairly, severely, and in clear defiance of labour laws



  27. Learning From the Mistakes of the US Patent System (and More Latterly China) When Assessing Patent Maximalism

    The warning signs coming both from the East and from the West, demonstrating the pitfalls of a policy too permissive on patents and thus on litigation



  28. The International Labour Organisation Once Again Proves Useless for Labour of the EPO

    The International Labour Organisation (ILO) is once again failing too serve justice, instead just sending complaints elsewhere, in effect into a black hole



  29. CERN Slams the European Patent Office for Abuse of Employees

    The European Organisation for Nuclear Research known as CERN is openly condemning EPO management and the Administrative Council for violation of human/labour rights, not to mention the other abuses that are rampant under Battistelli's notorious regime



  30. Links 28/11/2016: X-Plane 11 Beta, Early Work For C++20, Microsoft Hole in RHEL

    Links for the day


CoPilotCo

RSS 64x64RSS Feed: subscribe to the RSS feed for regular updates

Home iconSite Wiki: You can improve this site by helping the extension of the site's content

Home iconSite Home: Background about the site and some key features in the front page

Chat iconIRC Channel: Come and chat with us in real time

CoPilotCo

Recent Posts