EditorsAbout the SiteComes vs. MicrosoftUsing This Web SiteSite ArchivesCredibility IndexOOXMLOpenDocumentPatentsNovellNews DigestSite NewsRSS

06.30.09

Microsoft’s Latest Benchmark Fraud

Posted in Database, Deception, Fraud, FUD, GNU/Linux, IBM, Marketing, Microsoft, Oracle, SUN, UNIX at 3:34 am by Dr. Roy Schestowitz

Lie: MS SQL Oracle fake compare

Summary: Microsoft’s advertising is still a scam and should be dealt with appropriately

EARLIER THIS MONTH we wrote about Microsoft coming under threat of lawsuits due to these very same practices. The victim of benchmark fraud was IBM at the time and this time it is Oracle.

One of our readers got us a scan of the advert (see above). “It’s kinda small,” he says, “but you might find it interesting.” Here is the benchmark the advert is mentioning. To quote: “New results from SAP show that on similarly configured systems, SQL Server 2000 running on Windows Server 2003 outperformed Oracle 9i running on HP-UX. The highest Fully Processed Line Items Per hour, 178,000, has SAP certification number 2005017, and the highest 4-way Oracle result in this benchmark is 88,670, with SAP certification number 2004030.

“Such benchmark fraud should be reported to the ASA for deceptive marketing.”They neglect to say that MSSQL server is 8 cores, whereas the Oracle server is 4 cores. Oiaohm adds that “HP-UX has the lowest benchmarks with Oracle. Solaris and Linux outscore it. Basically, Microsoft cheats on benchmarks at every chance. [...] Also thinking Oracle also runs on Windows. Benchmark was very incomplete. [...] Also lower clock speed processors.”

“It’s a really stacked config,” adds the person who sent us this information. “Even with it not being HPUX, you are looking at 4 dual-core Opterons versus 4 single-core Itanium2 processors. Quite a big speed difference too.”

To conclude, he adds: “The point was to show MSSQL was faster than Oracle. They want you to buy their database, not just the OS. It’s just one more effort on Microsoft’s part to spin bad data into a convincing glossy blurb to appeal to the C-levels I don’t mind if they do a fair comparison and win, but this kind of stuff just hurts their credibility.”

Such benchmark fraud should be reported to the ASA for deceptive marketing. This has happened before and the same should be done about “<vendor> recommends Vista” [1, 2] and other marketing schemes, maybe even “it’s better with Windows” [1, 2].

Microsoft keeps wondering why it is not liked in IT circles. It is not because “it’s a big company.”

“Microsoft did sponsor the benchmark testing and the NT server was better tuned than the Linux one. Having said that, I must say that I still trust the Windows NT server would have outperformed the Linux one.”

Windows platform manager, Microsoft South Africa
Reference: Outrage at Microsoft’s independent, yet sponsored NT 4.0/Linux research

Share this post: These icons link to social bookmarking sites where readers can share and discover new web pages.
  • Digg
  • del.icio.us
  • Reddit
  • co.mments
  • DZone
  • email
  • Google Bookmarks
  • LinkedIn
  • NewsVine
  • Print
  • Technorati
  • TwitThis
  • Facebook

If you liked this post, consider subscribing to the RSS feed or join us now at the IRC channels.

Pages that cross-reference this one

2 Comments

  1. Jose_X said,

    June 30, 2009 at 11:47 pm

    Gravatar

    I’ll repeat what I said here for the IBM lawsuit story http://www.eweekeurope.co.uk/news/ibm-goes-legal-over-microsoft-s-websphere-claims-1076
    *****
    Here is a simple recipe.

    Keep in mind this is a hypothetical exercise.

    We have two pieces of hardware: A (ours) and B (theirs).

    We have the corresponding platform software: for A (our platform sw) and for B (their platform sw).

    We have the product being tested on each (in this case, it’s their server software).

    The first step is to make sure we find an A so that it outperforms their B hardware. This is easy to do unless B is the fastest supercomputer on record. It isn’t, obviously, so we can definitely find an A that beats whatever B is. [Eg, a 4gighz x86 beats a 1gighz x86 from the same vendor.]

    Each platform software performs about the same as the other under ordinary circumstances (or maybe ours is a bit worse). This means we will optimize extra for the occasion. This is easy to do by removing security and other tests. We can keep special task/process related memory objects around preinitialized in anticipation. We can simplify and speed up our scheduling. We can give the special process high priority to the CPU and to the filesystem (bypassing security checks, etc). We put everything else, including the GUI, into slow low priority mode. We turn kernel dynamic lists into static lists. Etc. Really, it is possible to optimize well for the occasion if we know the system will only be used for a specific purpose (to win in some benchmark). Also, the platform software we chose for their side is their generic platform software if possible (eg, their regular platform software not optimized for this benchmark).

    So that is how we easily got the improved performance.

    However, we need to control further context in order to pull off the coop. What about the price, right? After all, a supercomputer outperforms a pocket calculator, but people don’t buy supercomputers to compute tax at the restaurant. The context in this case is that the supercomputer is a LOT MORE expensive. We need to get the price of our “supercomputer” down to a competitive level.

    Here is how we carry out this step. We work with the hardware partner. They develop an exclusive model that they will price near cost. We also give away our platform software at near cost (it’s a “special configuration” remember). Voila! We got our costs down because we and our partner have no intention to actually sell many of these models to actual customers.

    So we kick their buttocks, and customers flock to our product.

    Then…

    The hardware model runs out quickly and a very slightly differently named/numbered hardware model is put in its place at a higher price.

    Also, our platform software is changed back to normal, except that now, it actually doesn’t run their server software all that well in comparison to our own server software that competes with theirs (but which was not tested in the benchmark). It’s extremely easy to change platform software bits around so that one app that was favored is no longer favored and is actually handicapped. It’s also very difficult to catch this if third parties don’t have the source code. Also, for subtlety, this change in the platform can be achieved later on through one or more automatic online updates/patches.

    Of course, the price of the platform software also goes up eventually, if not initially. Maybe its price goes up at the one year renewal or else when they exceed an artificially low user count. Or perhaps the price is raised transparently through the bundled software/service package “deal” the customer actually ended up buying. There are many ways to guide them into these higher priced options.

    Profit.

    Recap: We found better hardware, tweaked only our platform software to game the benchmark, and artificially lowered the price on this model in order to win the benchmark price comparison test. Then we switched this system with a regular one, threw in some more items, and modified the platform software (over time) to disfavor their application that we favored for the benchmark. Through this bait and switch we won the contract, and later by controlling the platform software, we disgraced their product to upsell our product in its place. We had the slightly worse software perhaps yet won and pulled in much more money than what they were advertising as their price tag. A full sleigh of hand.

    This is dirty, absolutely. It’s deceptive. It’s anti-consumer and anti-competitive. It likely leverages monopolies later on in the upsell. It is perfectly within Microsoft’s capabilities to pull off. It would be consistent with Microsoft’s past behavior.

    Keep in mind, however, that this was only a hypothetical exercise.

    Jose_X Reply:

    I should point out that the scenarios are different because the stacks are different (in the IBM case, it was the same IBM product that was tested on two different platforms).

    What doesn’t change is the story about deception.. which is also a story about trust.

What Else is New


  1. Links 28/7/2016: CORD as Linux Foundation Project, Wine 1.9.15 Released

    Links for the day



  2. EPO Loses More Than 80% of Cases at the International Labour Organisation (ILO)

    The International Labour Organisation (or Organization) helps show just to what degree the European Patent Office (EPO) violates the rights of workers



  3. To Understand What Battistelli Has Turned the EPO Into Look at Turkey and China

    Battistelli and his notorious Vice-President from SIPO (Croatia) turn the European Patent Office, once the pride of Europe, into a human rights cesspool with SIPO (China) connections



  4. Patent Lawyers Move Closer to Battistelli's Rubber-stamping Office While the Appeal Boards Pushed Away as Collective Punishment Which Masks Decline in Patent Quality

    Urgently sending appeal boards away and urgently granting applicants patents without proper examination will be Battistelli's sorrow legacy at the European Patent Office



  5. Software Patents a Dying Breed, But Patent Lawyers in Denial Over it and Notorious Judge Rodney Gilstrap Ignores Alice (Supreme Court)

    A look at what law and practice are saying about software patents, contrasted or contradicted by the patent industry and trolls-friendly courts (which make business out of or together with patent aggressors)



  6. CAFC Meddling in PTAB Affairs; Unified Patents Fights a Good Fight by Invalidating Software Patents

    A look at how the AIA's Patent Trial and Appeal Board is invalidating software patents post-Alice, with or without involvement of patent courts



  7. Early Certainty That Benoît Battistelli is Dangerously Clueless and a Major Risk to the EPO

    The chaos which Team Battistelli is assured to deliver if it doesn't treat scientists like scientists, instead viewing them as a production line with rubber-stamping duties



  8. OIN Makes Claims About “Open Source Innovation”, But It Produces Nothing and Protects Virtually Nobody

    The Open Invention Network (OIN) reports growth, but in practical terms it does little or nothing to help developers of Free/Open Source software



  9. Links 27/7/2016: New CrossOver, Blackmagic for GNU/Linux

    Links for the day



  10. The Death of Software Patents and Microsoft's Coup Against Yahoo! Made the Company Worthless

    A look at what happens to companies whose value is a house of software patents rather than code and a broad base of users/customers



  11. Munich Attack Mentioned by EPO But Not Ansbach

    The EPO does the usual right-wing thing (exploiting disaster/emergency for domestic crackdowns), but some bemoan the omission of the explosion at Ansbach (also in Germany)



  12. Kluwer Thinks People Are Clueless About the Unitary Patent System and Pretends It's Business as Usual

    Flogging the dead UPC horse at times of great uncertainty (enough to bring the UPC to a standstill)



  13. Almost Everything That the Government Accountability Office Says is Applicable to the EPO

    The Government Accountability Office in the United States produces reports which can serve as a timely warning sign to the European Patent Office, where patent quality is rapidly declining in order to meet 'production' goals



  14. Microsoft Says It Loves Linux, But Its Anti-Linux Patent Trolls Are Still Around and Active

    Highlighting just two of the many entities that Microsoft (and partners) use in order to induce additional costs on Free (as in freedom) software



  15. Links 26/7/2016: Microsoft Growing Desperate, Linux 4.8 Visions

    Links for the day



  16. Links 25/7/2016: Linux 4.7 Final, PostgreSQL 9.6 Beta 3

    Links for the day



  17. Leaked: Boards of Appeal Face 'Exile' or 'Extradition' in Haar After Standing up to Battistelli

    A look at some of the latest moves at the European Patent Office (EPO), following Battistelli's successful coup d’état which brought the EPO into a perpetual state of emergency that perpetuates Battistelli's totalitarian powers



  18. The US Government Accountability Office (GAO) Comes Across as Against Software Patents, Relates to the EPO as Well

    Some analysis of the input from the Government Accountability Office (GAO) with focus on the EPO and software patents



  19. In the US, Patent Trolls Engage in Patent Wars and Shakedowns, Whereas in China/Korea Large Android OEMs Sue One Another

    Highlighting some of the differences between the US patent system and other patent systems



  20. Links 24/7/2016: Elive 2.7.1 Beta, New Flatpaks and Snaps

    Links for the day



  21. Links 23/7/2016: Leo Laporte on GNU/Linux, Dolphin Emulator’s Vulkan Completion

    Links for the day



  22. Links 22/7/2016: Wine 1.9.15, KaOS 2016.07 ISO

    Links for the day



  23. Haar Mentioned as Likely Site of Appeal Boards as Their Eradication or Marginalisation Envisioned by UPC Proponent Benoît Battistelli

    Not only the Staff Union of the European Patent Office (SUEPO) is under severe attack and possibly in mortal danger; the increasingly understaffed Boards of Appeal too are coming under attack and may (according to rumours) be sent to Haar, a good distance away from Munich and the airport (half an hour drive), not to mention lack of facilities for visitors from overseas



  24. EPO Attaché Albert Keyack Viewed as Somewhat of a Mole, Reporting From the US Embassy in Brazil Until Shortly Before the Temer Coup

    Public responses to the role played by Albert Keyack on behalf of the United States inside the European [sic] Patent Office



  25. EPO Insiders Explain Why the EPO's Examination Quality Rapidly Declines and Will Get Even Worse Because of Willy Minnoye

    Public comments from anonymous insiders serve to highlight a growing crisis inside the European Patent Office (EPO), where experienced/senior examiners are walking away and leaving an irreplaceable bunch of seats (due to high experience demands)



  26. Patents Roundup: BlackBerry, Huawei, PTAB, GAO, Aggressive Universities With Patents, and Software Patents in Europe

    Various bits and pieces of news regarding patents and their fast-changing nature in the United States nowadays



  27. Glimpse at Patent Systems Across the World: Better Quality Control at the USPTO Post-America Invents Act (2011), Unlike the EPO Post-Battistelli (2010)

    While the EPO reportedly strives to eliminate pendency and appeal windows altogether (rubberstamping being optimal performance as per the yardstick du jour), the USPTO introduces changes that would strengthen the system and shield innovation, not protect the business model of serial litigants



  28. Blockstream Has No Patents, But Pledges Not to Sue Using Patents

    Blockstream says that it comes in peace when it comes to software patents, which triggers speculations about coming Blockchain patent wars



  29. Links 21/7/2016: Ubuntu 16.04.1 LTS, Linux Mint 18 “Sarah” Xfce Beta

    Links for the day



  30. Links 21/7/2016: An Honorary Degree for Alan Cox, Looks Back at DebConf16

    Links for the day


CoPilotCo

RSS 64x64RSS Feed: subscribe to the RSS feed for regular updates

Home iconSite Wiki: You can improve this site by helping the extension of the site's content

Home iconSite Home: Background about the site and some key features in the front page

Chat iconIRC Channel: Come and chat with us in real time

CoPilotCo

Recent Posts