EditorsAbout the SiteComes vs. MicrosoftUsing This Web SiteSite ArchivesCredibility IndexOOXMLOpenDocumentPatentsNovellNews DigestSite NewsRSS

06.30.09

Microsoft’s Latest Benchmark Fraud

Posted in Database, Deception, Fraud, FUD, GNU/Linux, IBM, Marketing, Microsoft, Oracle, SUN, UNIX at 3:34 am by Dr. Roy Schestowitz

Lie: MS SQL Oracle fake compare

Summary: Microsoft’s advertising is still a scam and should be dealt with appropriately

EARLIER THIS MONTH we wrote about Microsoft coming under threat of lawsuits due to these very same practices. The victim of benchmark fraud was IBM at the time and this time it is Oracle.

One of our readers got us a scan of the advert (see above). “It’s kinda small,” he says, “but you might find it interesting.” Here is the benchmark the advert is mentioning. To quote: “New results from SAP show that on similarly configured systems, SQL Server 2000 running on Windows Server 2003 outperformed Oracle 9i running on HP-UX. The highest Fully Processed Line Items Per hour, 178,000, has SAP certification number 2005017, and the highest 4-way Oracle result in this benchmark is 88,670, with SAP certification number 2004030.

“Such benchmark fraud should be reported to the ASA for deceptive marketing.”They neglect to say that MSSQL server is 8 cores, whereas the Oracle server is 4 cores. Oiaohm adds that “HP-UX has the lowest benchmarks with Oracle. Solaris and Linux outscore it. Basically, Microsoft cheats on benchmarks at every chance. [...] Also thinking Oracle also runs on Windows. Benchmark was very incomplete. [...] Also lower clock speed processors.”

“It’s a really stacked config,” adds the person who sent us this information. “Even with it not being HPUX, you are looking at 4 dual-core Opterons versus 4 single-core Itanium2 processors. Quite a big speed difference too.”

To conclude, he adds: “The point was to show MSSQL was faster than Oracle. They want you to buy their database, not just the OS. It’s just one more effort on Microsoft’s part to spin bad data into a convincing glossy blurb to appeal to the C-levels I don’t mind if they do a fair comparison and win, but this kind of stuff just hurts their credibility.”

Such benchmark fraud should be reported to the ASA for deceptive marketing. This has happened before and the same should be done about “<vendor> recommends Vista” [1, 2] and other marketing schemes, maybe even “it’s better with Windows” [1, 2].

Microsoft keeps wondering why it is not liked in IT circles. It is not because “it’s a big company.”

“Microsoft did sponsor the benchmark testing and the NT server was better tuned than the Linux one. Having said that, I must say that I still trust the Windows NT server would have outperformed the Linux one.”

Windows platform manager, Microsoft South Africa
Reference: Outrage at Microsoft’s independent, yet sponsored NT 4.0/Linux research

Share this post: These icons link to social bookmarking sites where readers can share and discover new web pages.
  • Digg
  • del.icio.us
  • Reddit
  • co.mments
  • DZone
  • email
  • Google Bookmarks
  • LinkedIn
  • NewsVine
  • Print
  • Technorati
  • TwitThis
  • Facebook

If you liked this post, consider subscribing to the RSS feed or join us now at the IRC channels.

Pages that cross-reference this one

2 Comments

  1. Jose_X said,

    June 30, 2009 at 11:47 pm

    Gravatar

    I’ll repeat what I said here for the IBM lawsuit story http://www.eweekeurope.co.uk/news/ibm-goes-legal-over-microsoft-s-websphere-claims-1076
    *****
    Here is a simple recipe.

    Keep in mind this is a hypothetical exercise.

    We have two pieces of hardware: A (ours) and B (theirs).

    We have the corresponding platform software: for A (our platform sw) and for B (their platform sw).

    We have the product being tested on each (in this case, it’s their server software).

    The first step is to make sure we find an A so that it outperforms their B hardware. This is easy to do unless B is the fastest supercomputer on record. It isn’t, obviously, so we can definitely find an A that beats whatever B is. [Eg, a 4gighz x86 beats a 1gighz x86 from the same vendor.]

    Each platform software performs about the same as the other under ordinary circumstances (or maybe ours is a bit worse). This means we will optimize extra for the occasion. This is easy to do by removing security and other tests. We can keep special task/process related memory objects around preinitialized in anticipation. We can simplify and speed up our scheduling. We can give the special process high priority to the CPU and to the filesystem (bypassing security checks, etc). We put everything else, including the GUI, into slow low priority mode. We turn kernel dynamic lists into static lists. Etc. Really, it is possible to optimize well for the occasion if we know the system will only be used for a specific purpose (to win in some benchmark). Also, the platform software we chose for their side is their generic platform software if possible (eg, their regular platform software not optimized for this benchmark).

    So that is how we easily got the improved performance.

    However, we need to control further context in order to pull off the coop. What about the price, right? After all, a supercomputer outperforms a pocket calculator, but people don’t buy supercomputers to compute tax at the restaurant. The context in this case is that the supercomputer is a LOT MORE expensive. We need to get the price of our “supercomputer” down to a competitive level.

    Here is how we carry out this step. We work with the hardware partner. They develop an exclusive model that they will price near cost. We also give away our platform software at near cost (it’s a “special configuration” remember). Voila! We got our costs down because we and our partner have no intention to actually sell many of these models to actual customers.

    So we kick their buttocks, and customers flock to our product.

    Then…

    The hardware model runs out quickly and a very slightly differently named/numbered hardware model is put in its place at a higher price.

    Also, our platform software is changed back to normal, except that now, it actually doesn’t run their server software all that well in comparison to our own server software that competes with theirs (but which was not tested in the benchmark). It’s extremely easy to change platform software bits around so that one app that was favored is no longer favored and is actually handicapped. It’s also very difficult to catch this if third parties don’t have the source code. Also, for subtlety, this change in the platform can be achieved later on through one or more automatic online updates/patches.

    Of course, the price of the platform software also goes up eventually, if not initially. Maybe its price goes up at the one year renewal or else when they exceed an artificially low user count. Or perhaps the price is raised transparently through the bundled software/service package “deal” the customer actually ended up buying. There are many ways to guide them into these higher priced options.

    Profit.

    Recap: We found better hardware, tweaked only our platform software to game the benchmark, and artificially lowered the price on this model in order to win the benchmark price comparison test. Then we switched this system with a regular one, threw in some more items, and modified the platform software (over time) to disfavor their application that we favored for the benchmark. Through this bait and switch we won the contract, and later by controlling the platform software, we disgraced their product to upsell our product in its place. We had the slightly worse software perhaps yet won and pulled in much more money than what they were advertising as their price tag. A full sleigh of hand.

    This is dirty, absolutely. It’s deceptive. It’s anti-consumer and anti-competitive. It likely leverages monopolies later on in the upsell. It is perfectly within Microsoft’s capabilities to pull off. It would be consistent with Microsoft’s past behavior.

    Keep in mind, however, that this was only a hypothetical exercise.

    Jose_X Reply:

    I should point out that the scenarios are different because the stacks are different (in the IBM case, it was the same IBM product that was tested on two different platforms).

    What doesn’t change is the story about deception.. which is also a story about trust.

What Else is New


  1. Alice Case Beats Microsoft Patent Troll, USPTO Director Michelle Lee Wants Reform

    Latest developments surrounding software patents and patent trolls in the United States



  2. Links 7/7/2015: Lenovo ThinkPad With GNU/Linux, More Containers Hype

    Links for the day



  3. There is No 'New Microsoft': Under Nadella, Patent Extortion Against Linux/Android Carries on

    Kyocera is again being targeted by Microsoft, using patent aggression, with a secret settlement being reached whose negative impact on Android remains to be seen



  4. Patent Propaganda, Glamourisation, and Erosion of Citizens' Rights in the Process

    An overview of recent coverage about patents, demonstrative of inherent bias in the world of patent practitioners and the journalists whom they misinform



  5. Corporate Media Should Stop Grooming Black Duck by Calling it 'Open Source' and Repeating Its Lies

    Black Duck uses gullible (or easy to manipulate) journalists to spread its marketing talking points, which grossly overstate risks of using Free software



  6. Links 6/7/2015: Linux 4.2-rc1, YotaPhone Picks Sailfish OS

    Links for the day



  7. Microsoft Windows Unsafe at Any Speed, by Design

    More timely reminders that Windows is simply not designed to be secure, irrespective of version, status of patching, etc.



  8. After Moonlight Dies and Even Microsoft Abandons Silverlight, the Abusive Monopolist Keeps Pushing for Other Microsoft Lock-in, Injecting OOXML Traps Into Free Software (Moodle)

    Despite a long history of Microsoft formats being proven guarantee of digital obsolescence, Moodle allows itself to become Microsoft prey and a Trojan horse for OOXML in classrooms (for children)



  9. Links 4/7/2015: Mostly (Geo)Political Catchup

    Links for the day



  10. Links 3/7/2015: KDE Applications 15.04.3, Ubuntu-Flavored Compute Stick

    Links for the day



  11. Patent Lawyers and Their Firms, Still Desperate to Protect the Status Quo, Manipulate the Media

    Patent lawyers are besieged by gradual tightening of patent scope and recklessly fight back (e.g. by saturating the media) to secure their revenue sources, derived from (and at the expense of) actual scientists and true market producers



  12. Amid Controversy, Political Scrutiny and Increased Media Pressure Željko Topić and Benoît Battistelli Allegedly Cancel Today's Trip to Zagreb (Croatia) Where Topić Faces Many Criminal Charges

    The Croatian press comments on the recent declaration from the Council of Europe and Topić's not-so-sterling status in his home country, where he is wanted for alleged crimes



  13. Microsoft Gradually Embraces, Extends, Extinguishes Linux Foundation as a Foundation of GNU/Linux

    By liaising with (or hijacking) existing members of the Linux Foundation, as well as by paying the Linux Foundation, Microsoft turns the Linux Foundation into somewhat of a Windows advocacy group



  14. Microsoft India Still Lobbies and Lies About Free Software in Order to Knock Down Policy That Favours Free Software

    Microsoft continues to bully Indian politicians who merely 'dare' to prefer software that India can modify, maintain, extend, audit, etc.



  15. Patent Lawyers and Corporate Media Nervous About New Patents Barrier/Reality (Less Patents on Software and Business Methods)

    The rich and the powerful, as well as their lawyers (whose job is to protect their money and power by means of government-enforced monopoly), carry on whining after the Alice case, in which many abstract patents were essentially ruled -- by extension -- invalid



  16. Translation of Pierre-Yves Le Borgn' Speech Against EPO Management and New Parliamentarian Interventions

    More political fire targeting the EPO's management, adding up to over 100 parliamentarians by now



  17. Links 2/7/2015: KDE Plasma 5.3.2, antiX 15

    Links for the day



  18. Links 1/7/2015: OpenDaylight Lithium, OpenMandriva Lx 2014.2

    Links for the day



  19. Munich Press, Münchner Merkur, Slams the Munich-based EPO

    Pressure on Benoît Battistelli to leave (or be fired) grows as the cronies whom he filled his office with have become a huge public embarrassment to the decades-old European Patent Office



  20. The Shameless Campaign to Paint/Portray Free Software as Inherently Insecure, Using Brands, Logos, and Excessive, Selective Press Coverage

    Some more FUD from firms such as Sonatype, which hope to make money by making people scared of Free/libre software



  21. National Insecurity and Blackmail, Courtesy of Microsoft

    British members of parliament (MPs) outsourced their communication to the number one PRISM company and they are paying the price for it; The US Navy's systems continue to be unbelievably insecure (Windows XP), despite access to the world's biggest nuclear arsenal



  22. Microsoft Keeps Shrinking

    As the era of shrink-wrapped software comes to an end so does Microsoft, whose effort to become a 'cloud' company with online operations has been miserable at best



  23. They 'R' Coming: More Microsoft Money for the Linux Foundation

    The problem with having Microsoft in a Linux Foundation initiative, the R Consortium



  24. Speculations About the EPO's Possible Role in DDOS Attacks

    Readers' views on who might be behind the attacks on this site amid confirmation that it's on the 'targets' list of the EPO



  25. Links 30/6/2015: Linux Mint 17.2, OpenMandriva

    Links for the day



  26. Techrights Confirmed as a Target of EPO Surveillance, With Help From Control Risks Group (CRG)

    Unveiling the cloak of secrecy from long-term surveillance by the European Patent Office (EPO) and a London-based mercenary it hired, bypassing the law



  27. Google's Fight to Keep APIs Free is Lost, Let's Hope Google Continues Fighting

    SCOTUS refuses to rule that APIs cannot be considered copyright-'protected', despite common sense and despite Java (which the case is about) being Free/libre software



  28. Patent Trolls in the Post-Alice World

    A round-up of news about patent trolls in the United States, some of whom are are doing well and some of them not as well



  29. DDOS Attacks Against Techrights

    Information about some of the most recent DDOS attacks against this Web site and the steps to be taken next



  30. The Patent System Not What it Used to be, Large Corporations and Patent Lawyers the Principal Beneficiaries

    A look at some recent patent stories and what can be deduced from them, based on statistics and trends


CoPilotCo

RSS 64x64RSS Feed: subscribe to the RSS feed for regular updates

Home iconSite Wiki: You can improve this site by helping the extension of the site's content

Home iconSite Home: Background about the site and some key features in the front page

Chat iconIRC Channel: Come and chat with us in real time

CoPilotCo

Recent Posts