EditorsAbout the SiteComes vs. MicrosoftUsing This Web SiteSite ArchivesCredibility IndexOOXMLOpenDocumentPatentsNovellNews DigestSite NewsRSS

06.30.09

Microsoft’s Latest Benchmark Fraud

Posted in Database, Deception, Fraud, FUD, GNU/Linux, IBM, Marketing, Microsoft, Oracle, SUN, UNIX at 3:34 am by Dr. Roy Schestowitz

Lie: MS SQL Oracle fake compare

Summary: Microsoft’s advertising is still a scam and should be dealt with appropriately

EARLIER THIS MONTH we wrote about Microsoft coming under threat of lawsuits due to these very same practices. The victim of benchmark fraud was IBM at the time and this time it is Oracle.

One of our readers got us a scan of the advert (see above). “It’s kinda small,” he says, “but you might find it interesting.” Here is the benchmark the advert is mentioning. To quote: “New results from SAP show that on similarly configured systems, SQL Server 2000 running on Windows Server 2003 outperformed Oracle 9i running on HP-UX. The highest Fully Processed Line Items Per hour, 178,000, has SAP certification number 2005017, and the highest 4-way Oracle result in this benchmark is 88,670, with SAP certification number 2004030.

“Such benchmark fraud should be reported to the ASA for deceptive marketing.”They neglect to say that MSSQL server is 8 cores, whereas the Oracle server is 4 cores. Oiaohm adds that “HP-UX has the lowest benchmarks with Oracle. Solaris and Linux outscore it. Basically, Microsoft cheats on benchmarks at every chance. [...] Also thinking Oracle also runs on Windows. Benchmark was very incomplete. [...] Also lower clock speed processors.”

“It’s a really stacked config,” adds the person who sent us this information. “Even with it not being HPUX, you are looking at 4 dual-core Opterons versus 4 single-core Itanium2 processors. Quite a big speed difference too.”

To conclude, he adds: “The point was to show MSSQL was faster than Oracle. They want you to buy their database, not just the OS. It’s just one more effort on Microsoft’s part to spin bad data into a convincing glossy blurb to appeal to the C-levels I don’t mind if they do a fair comparison and win, but this kind of stuff just hurts their credibility.”

Such benchmark fraud should be reported to the ASA for deceptive marketing. This has happened before and the same should be done about “<vendor> recommends Vista” [1, 2] and other marketing schemes, maybe even “it’s better with Windows” [1, 2].

Microsoft keeps wondering why it is not liked in IT circles. It is not because “it’s a big company.”

“Microsoft did sponsor the benchmark testing and the NT server was better tuned than the Linux one. Having said that, I must say that I still trust the Windows NT server would have outperformed the Linux one.”

Windows platform manager, Microsoft South Africa
Reference: Outrage at Microsoft’s independent, yet sponsored NT 4.0/Linux research

Share this post: These icons link to social bookmarking sites where readers can share and discover new web pages.
  • Digg
  • del.icio.us
  • Reddit
  • co.mments
  • DZone
  • email
  • Google Bookmarks
  • LinkedIn
  • NewsVine
  • Print
  • Technorati
  • TwitThis
  • Facebook

If you liked this post, consider subscribing to the RSS feed or join us now at the IRC channels.

Pages that cross-reference this one

2 Comments

  1. Jose_X said,

    June 30, 2009 at 11:47 pm

    Gravatar

    I’ll repeat what I said here for the IBM lawsuit story http://www.eweekeurope.co.uk/news/ibm-goes-legal-over-microsoft-s-websphere-claims-1076
    *****
    Here is a simple recipe.

    Keep in mind this is a hypothetical exercise.

    We have two pieces of hardware: A (ours) and B (theirs).

    We have the corresponding platform software: for A (our platform sw) and for B (their platform sw).

    We have the product being tested on each (in this case, it’s their server software).

    The first step is to make sure we find an A so that it outperforms their B hardware. This is easy to do unless B is the fastest supercomputer on record. It isn’t, obviously, so we can definitely find an A that beats whatever B is. [Eg, a 4gighz x86 beats a 1gighz x86 from the same vendor.]

    Each platform software performs about the same as the other under ordinary circumstances (or maybe ours is a bit worse). This means we will optimize extra for the occasion. This is easy to do by removing security and other tests. We can keep special task/process related memory objects around preinitialized in anticipation. We can simplify and speed up our scheduling. We can give the special process high priority to the CPU and to the filesystem (bypassing security checks, etc). We put everything else, including the GUI, into slow low priority mode. We turn kernel dynamic lists into static lists. Etc. Really, it is possible to optimize well for the occasion if we know the system will only be used for a specific purpose (to win in some benchmark). Also, the platform software we chose for their side is their generic platform software if possible (eg, their regular platform software not optimized for this benchmark).

    So that is how we easily got the improved performance.

    However, we need to control further context in order to pull off the coop. What about the price, right? After all, a supercomputer outperforms a pocket calculator, but people don’t buy supercomputers to compute tax at the restaurant. The context in this case is that the supercomputer is a LOT MORE expensive. We need to get the price of our “supercomputer” down to a competitive level.

    Here is how we carry out this step. We work with the hardware partner. They develop an exclusive model that they will price near cost. We also give away our platform software at near cost (it’s a “special configuration” remember). Voila! We got our costs down because we and our partner have no intention to actually sell many of these models to actual customers.

    So we kick their buttocks, and customers flock to our product.

    Then…

    The hardware model runs out quickly and a very slightly differently named/numbered hardware model is put in its place at a higher price.

    Also, our platform software is changed back to normal, except that now, it actually doesn’t run their server software all that well in comparison to our own server software that competes with theirs (but which was not tested in the benchmark). It’s extremely easy to change platform software bits around so that one app that was favored is no longer favored and is actually handicapped. It’s also very difficult to catch this if third parties don’t have the source code. Also, for subtlety, this change in the platform can be achieved later on through one or more automatic online updates/patches.

    Of course, the price of the platform software also goes up eventually, if not initially. Maybe its price goes up at the one year renewal or else when they exceed an artificially low user count. Or perhaps the price is raised transparently through the bundled software/service package “deal” the customer actually ended up buying. There are many ways to guide them into these higher priced options.

    Profit.

    Recap: We found better hardware, tweaked only our platform software to game the benchmark, and artificially lowered the price on this model in order to win the benchmark price comparison test. Then we switched this system with a regular one, threw in some more items, and modified the platform software (over time) to disfavor their application that we favored for the benchmark. Through this bait and switch we won the contract, and later by controlling the platform software, we disgraced their product to upsell our product in its place. We had the slightly worse software perhaps yet won and pulled in much more money than what they were advertising as their price tag. A full sleigh of hand.

    This is dirty, absolutely. It’s deceptive. It’s anti-consumer and anti-competitive. It likely leverages monopolies later on in the upsell. It is perfectly within Microsoft’s capabilities to pull off. It would be consistent with Microsoft’s past behavior.

    Keep in mind, however, that this was only a hypothetical exercise.

    Jose_X Reply:

    I should point out that the scenarios are different because the stacks are different (in the IBM case, it was the same IBM product that was tested on two different platforms).

    What doesn’t change is the story about deception.. which is also a story about trust.

What Else is New


  1. Links 22/10/2014: Chromebooks Surge, NSA Android Endorsement

    Links for the day



  2. Links 21/10/2014: Debian Fork Debate, New GNU IceCat

    Links for the day



  3. Criminal Microsoft is Censoring the Web and Breaks Laws to Do So; the Web Should Censor (Remove) Microsoft

    Microsoft is still breaking the Internet using completely bogus takedown requests (an abuse of DMCA) and why Microsoft Windows, which contains weaponised back doors (shared with the NSA), should be banned from the Internet, not just from the Web



  4. Microsoft 'Loving' GNU/Linux and Other Corporate Media Fiction

    Microsoft has bullied or cleverly bribed enough technology-centric media sites to have them characterise Microsoft as a friend of Free/Open Source software (FOSS) that also "loves Linux"



  5. India May be Taking Bill Gates to Court for Misusing His So-called 'Charity' to Conduct Clinical Trials Without Consent on Behalf of Companies He Invests in

    Bill Gates may finally be pulled into the courtroom again, having been identified for large-scale abuses that he commits in the name of profit (not "charity")



  6. The Problems With Legal Workarounds, Patent Scope, and Expansion of Patent Trolls to the East

    Patent trolls are in the news again and it's rather important, albeit for various different reasons, more relevant than the ones covered here in the past



  7. Links 20/10/2014: Cloudera and Red Hat, Debian 7.7, and Vivid Vervet

    Links for the day



  8. Links 20/10/2014: 10 Years Since First Ubuntu Release

    Links for the day



  9. How Patent Lawyers Analyze Alice v. CLS Bank

    Breaking down a patent lawyer's analysis of a Supreme Court's decision that seemingly invalidated hundreds of thousands of software patents



  10. Is It Google's Turn to Head the USPTO Corporation?

    The industry-led USPTO continues to be coordinated by some of its biggest clients, despite issues associated with conflicting interests



  11. The EPO's Public Relations Disaster Amid Distrust From Within (and EPO Communications Chief Leaves): Part VII

    Amid unrest and suspicion of misconduct in the EPO's management (ongoing for months if not years), Transparency International steps in, but the EPO's management completely ignores Transparency International, refusing to collaborate; the PR chief of the EPO is apparently being pushed out in the mean time



  12. Links 18/10/2014: Debian Plans for Init Systems, Tails 1.2

    Links for the day



  13. Links 18/10/2014: New ELive, Android Expansion

    Links for the day



  14. Another Fresh Blow to Software Patents (and With Them Patent Trolls)

    Another new development shows that more burden of proof is to be put on the litigant, thus discouraging the most infamous serial patent aggressors and reducing the incentive to settle with a payment out of court



  15. Links 16/10/2014: New Android, SSL 3.0 Flaw

    Links for the day



  16. How the Corporate Press Deceives and Sells Microsoft Agenda

    Various new examples of media propaganda that distorts or makes up the facts (bias/lies by omission/selection) and where this is all coming from



  17. Vista 10 is Still Vapourware, But We Already Know It Will Increase Surveillance on Its Users and Contain Malicious Back Doors

    The villainous company which makes insecure-by-design operating systems will continue to do so, but in the mean time the corporate press covers only bugs in FOSS, not back doors in proprietary software



  18. Links 15/10/2014: KDE Plasma 5.1 is Out, GOG Reaches 100-Title Mark

    Links for the day



  19. With .NET Foundation Affiliation Xamarin is Another Step Closer to Being Absorbed by Microsoft

    Xamarin is not even trying to pretend that separation exists between Microsoft and its work; yet another collaboration is announced



  20. The EPO's Protection Triangle of Battistelli, Kongstad, and Topić: Part VI

    Jesper Kongstad, Benoît Battistelli, and Zeljko Topić are uncomfortably close personally and professionally, so suspicions arise that nepotism and protectionism play a negative role that negatively affects the European public



  21. Corporate Media Confirms the Demise of Software Patents in the United States; Will India and Europe Follow?

    It has become increasingly official that software patents are being weakened in the United States' USPTO as well as the courts; will software leaders such as India and Europe stop trying to imitate the old USPTO?



  22. Links 14/10/2014: CAINE 6, New RHEL, Dronecode

    Links for the day



  23. Microsoft's Disdain for Women Steals the Show at a Women's Event

    Steve Ballmer's successor, Satya Nadella, is still too tactless to lie to the audience, having been given --through subversive means -- a platform at a conference that should have shunned Microsoft, a famously misogynistic company



  24. SCOTUS May Soon Put an End to the 'Copyrights on APIs' Question While Proprietary Giants Continue to Harass Android/Linux in Every Way Conceivable

    Google takes its fight over API freedom to the Supreme Court in the Unites States and it also takes that longstanding patent harassment from the Microsoft- and Apple-backed troll (Rockstar) out of East Texas



  25. Patent Lawsuits Almost Halved After SCOTUS Ruling on 'Abstract' Software Patents

    The barrier for acceptance of software patent applications is raised in the United States and patent lawsuits, many of which involve software these days, are down very sharply, based on new figures from Lex Machina



  26. Links 13/10/2014: ChromeOS and EXT, Debian Resists Systemd Domination

    Links for the day



  27. Links 12/10/2014: Blackphone Tablet, Sony's Firefox OS Port

    Links for the day



  28. Links 9/10/2014: Free Software in Germany, Lenovo Tablets With Android

    Links for the day



  29. Links 8/10/2014: A Lot of Linux+AMD News, New ROSA Desktop Is Out

    Links for the day



  30. Lawyers' Propaganda About Software Patents and a New AstroTurf Entity Called Innovation Alliance

    Patent propaganda and deception from patent lawyers (among other parasites such as patent trolls) continues to flood the Web, intersecting with reports that prove them totally wrong


CoPilotCo

RSS 64x64RSS Feed: subscribe to the RSS feed for regular updates

Home iconSite Wiki: You can improve this site by helping the extension of the site's content

Home iconSite Home: Background about the site and some key features in the front page

Chat iconIRC Channel: Come and chat with us in real time

CoPilotCo

Recent Posts