EditorsAbout the SiteComes vs. MicrosoftUsing This Web SiteSite ArchivesCredibility IndexOOXMLOpenDocumentPatentsNovellNews DigestSite NewsRSS

06.30.09

Microsoft’s Latest Benchmark Fraud

Posted in Database, Deception, Fraud, FUD, GNU/Linux, IBM, Marketing, Microsoft, Oracle, SUN, UNIX at 3:34 am by Dr. Roy Schestowitz

Lie: MS SQL Oracle fake compare

Summary: Microsoft’s advertising is still a scam and should be dealt with appropriately

EARLIER THIS MONTH we wrote about Microsoft coming under threat of lawsuits due to these very same practices. The victim of benchmark fraud was IBM at the time and this time it is Oracle.

One of our readers got us a scan of the advert (see above). “It’s kinda small,” he says, “but you might find it interesting.” Here is the benchmark the advert is mentioning. To quote: “New results from SAP show that on similarly configured systems, SQL Server 2000 running on Windows Server 2003 outperformed Oracle 9i running on HP-UX. The highest Fully Processed Line Items Per hour, 178,000, has SAP certification number 2005017, and the highest 4-way Oracle result in this benchmark is 88,670, with SAP certification number 2004030.

“Such benchmark fraud should be reported to the ASA for deceptive marketing.”They neglect to say that MSSQL server is 8 cores, whereas the Oracle server is 4 cores. Oiaohm adds that “HP-UX has the lowest benchmarks with Oracle. Solaris and Linux outscore it. Basically, Microsoft cheats on benchmarks at every chance. [...] Also thinking Oracle also runs on Windows. Benchmark was very incomplete. [...] Also lower clock speed processors.”

“It’s a really stacked config,” adds the person who sent us this information. “Even with it not being HPUX, you are looking at 4 dual-core Opterons versus 4 single-core Itanium2 processors. Quite a big speed difference too.”

To conclude, he adds: “The point was to show MSSQL was faster than Oracle. They want you to buy their database, not just the OS. It’s just one more effort on Microsoft’s part to spin bad data into a convincing glossy blurb to appeal to the C-levels I don’t mind if they do a fair comparison and win, but this kind of stuff just hurts their credibility.”

Such benchmark fraud should be reported to the ASA for deceptive marketing. This has happened before and the same should be done about “<vendor> recommends Vista” [1, 2] and other marketing schemes, maybe even “it’s better with Windows” [1, 2].

Microsoft keeps wondering why it is not liked in IT circles. It is not because “it’s a big company.”

“Microsoft did sponsor the benchmark testing and the NT server was better tuned than the Linux one. Having said that, I must say that I still trust the Windows NT server would have outperformed the Linux one.”

Windows platform manager, Microsoft South Africa
Reference: Outrage at Microsoft’s independent, yet sponsored NT 4.0/Linux research

Share this post: These icons link to social bookmarking sites where readers can share and discover new web pages.
  • Digg
  • del.icio.us
  • Reddit
  • co.mments
  • DZone
  • email
  • Google Bookmarks
  • LinkedIn
  • NewsVine
  • Print
  • Technorati
  • TwitThis
  • Facebook

If you liked this post, consider subscribing to the RSS feed or join us now at the IRC channels.

Pages that cross-reference this one

2 Comments

  1. Jose_X said,

    June 30, 2009 at 11:47 pm

    Gravatar

    I’ll repeat what I said here for the IBM lawsuit story http://www.eweekeurope.co.uk/news/ibm-goes-legal-over-microsoft-s-websphere-claims-1076
    *****
    Here is a simple recipe.

    Keep in mind this is a hypothetical exercise.

    We have two pieces of hardware: A (ours) and B (theirs).

    We have the corresponding platform software: for A (our platform sw) and for B (their platform sw).

    We have the product being tested on each (in this case, it’s their server software).

    The first step is to make sure we find an A so that it outperforms their B hardware. This is easy to do unless B is the fastest supercomputer on record. It isn’t, obviously, so we can definitely find an A that beats whatever B is. [Eg, a 4gighz x86 beats a 1gighz x86 from the same vendor.]

    Each platform software performs about the same as the other under ordinary circumstances (or maybe ours is a bit worse). This means we will optimize extra for the occasion. This is easy to do by removing security and other tests. We can keep special task/process related memory objects around preinitialized in anticipation. We can simplify and speed up our scheduling. We can give the special process high priority to the CPU and to the filesystem (bypassing security checks, etc). We put everything else, including the GUI, into slow low priority mode. We turn kernel dynamic lists into static lists. Etc. Really, it is possible to optimize well for the occasion if we know the system will only be used for a specific purpose (to win in some benchmark). Also, the platform software we chose for their side is their generic platform software if possible (eg, their regular platform software not optimized for this benchmark).

    So that is how we easily got the improved performance.

    However, we need to control further context in order to pull off the coop. What about the price, right? After all, a supercomputer outperforms a pocket calculator, but people don’t buy supercomputers to compute tax at the restaurant. The context in this case is that the supercomputer is a LOT MORE expensive. We need to get the price of our “supercomputer” down to a competitive level.

    Here is how we carry out this step. We work with the hardware partner. They develop an exclusive model that they will price near cost. We also give away our platform software at near cost (it’s a “special configuration” remember). Voila! We got our costs down because we and our partner have no intention to actually sell many of these models to actual customers.

    So we kick their buttocks, and customers flock to our product.

    Then…

    The hardware model runs out quickly and a very slightly differently named/numbered hardware model is put in its place at a higher price.

    Also, our platform software is changed back to normal, except that now, it actually doesn’t run their server software all that well in comparison to our own server software that competes with theirs (but which was not tested in the benchmark). It’s extremely easy to change platform software bits around so that one app that was favored is no longer favored and is actually handicapped. It’s also very difficult to catch this if third parties don’t have the source code. Also, for subtlety, this change in the platform can be achieved later on through one or more automatic online updates/patches.

    Of course, the price of the platform software also goes up eventually, if not initially. Maybe its price goes up at the one year renewal or else when they exceed an artificially low user count. Or perhaps the price is raised transparently through the bundled software/service package “deal” the customer actually ended up buying. There are many ways to guide them into these higher priced options.

    Profit.

    Recap: We found better hardware, tweaked only our platform software to game the benchmark, and artificially lowered the price on this model in order to win the benchmark price comparison test. Then we switched this system with a regular one, threw in some more items, and modified the platform software (over time) to disfavor their application that we favored for the benchmark. Through this bait and switch we won the contract, and later by controlling the platform software, we disgraced their product to upsell our product in its place. We had the slightly worse software perhaps yet won and pulled in much more money than what they were advertising as their price tag. A full sleigh of hand.

    This is dirty, absolutely. It’s deceptive. It’s anti-consumer and anti-competitive. It likely leverages monopolies later on in the upsell. It is perfectly within Microsoft’s capabilities to pull off. It would be consistent with Microsoft’s past behavior.

    Keep in mind, however, that this was only a hypothetical exercise.

    Jose_X Reply:

    I should point out that the scenarios are different because the stacks are different (in the IBM case, it was the same IBM product that was tested on two different platforms).

    What doesn’t change is the story about deception.. which is also a story about trust.

What Else is New


  1. Links 24/2/2017: Ubuntu 17.04 Beta, OpenBSD Foundation Nets $573,000 in Donations

    Links for the day



  2. IAM, Greased up by the EPO, Continues Lobbying by Shaming Tactics for the UPC, Under the Guise of 'News'

    The shrill and well-paid writers of IAM are still at it, promoting the Unitary Patent (UPC) at every opportunity and every turn



  3. Patent Scope Gone Awry: European Vegetable Patents Office?

    In its misguided race to raise so-called 'production', the EPO lost sight of its original goals and now facilitates patent royalty payments/taxation for naturally-recurring items of nature



  4. Yes, There is Definitely Brain Drain (Experience Deficit) at the European Patent Office and Stakeholders Feel It

    The direction that the European Patent Office has taken under Battistelli undoes many decades (almost half a century) of reputation-building and progress and naturally this repels existing staff, not to mention hampers recruitment efforts



  5. The Sickness of the EPO – Part IV: Cruel Management That Deliberately Attacks the Sick and the Weak

    The dysphoric reality at the European Patent Office, which is becoming like a large cell (with bolted-down windows) where people are controlled by fear and scapegoats are selected to perpetuate this atmosphere of terror and maintain demand (or workload) for the Investigative Stasi



  6. Links 23/2/2017: Qt 5.9 Alpha, First SHA1 Collision

    Links for the day



  7. UPC Roundup: War on the Appeal Boards, British Motion Against the UPC, Fröhlinger Recalled, and Fake News About Spain

    Taking stock of some of the latest attempts to shove the Unitary Patent (UPC) down Europe's throat, courtesy of Team Battistelli and Team UPC



  8. The Sickness of the EPO – Part III: Invalidity and Suicides

    An explanation of what drives a lot of EPO veterans to depression and sometimes even suicide



  9. The Appeal Board (PTAB) and Federal Circuit (CAFC) Maintain Good Pace of Patent Elimination Where Scope Was Exceeded

    The Court of Appeals for the Federal Circuit (CAFC) continues to accept about 4 out of 5 decisions of the Patent Trial and Appeal Board (PTAB) and the US Supreme Court (SCOTUS) refuses to intervene



  10. Software Patents Are Ebbing Away, But the “Swamp” Fights Back and Hijacks the Word “Fix”

    The club of patent maximalists, or those who profit from excess prosecution and legal chaos, isn't liking what has happened in the United States and it wants everything reversed



  11. Report From Yesterday's Debate About the European Patent Office (EPO) at the Bavarian Landtag

    A report of the EPO debate which took place at the Bavarian Landtag yesterday (21/2/2017)



  12. Links 22/2/2017: Wine-Staging 2.2, Nautilus 3.24

    Links for the day



  13. French Politician Richard Yung Tells the Government About Abuses at the European Patent Office (EPO)

    The subject of EPO scandals has once again landed in French politics, just a couple of months since it last happened



  14. The Sickness of the EPO – Part II: Background Information and Insights

    With a privatised, in-house (sometimes outsourced and for-profit) force for surveillance, policing, justice, public relations and now medical assessment (mere vassals or marionettes of the management) the EPO serves to show that it has become indistinguishable from North Korea, where the Supreme Leader gets to control every single aspect (absolutely no separation of powers)



  15. EPO Cartoon/Caricature by KrewinkelKrijst

    A new rendition by Dutch cartoonist and illustrator KrewinkelKrijst



  16. Inverting Narratives: IAM 'Magazine' Paints Massive Patent Bully Microsoft (Preying on the Weak) as a Defender of the Powerless

    Selective coverage and deliberate misinterpretation of Microsoft's tactics (patent settlement under threat, disguised as "pre-installation of some of the US company’s software products") as seen in IAM almost every week these days



  17. The Sickness of the EPO – Part I: Motivation for New Series of Articles

    An introduction or prelude to a long series of upcoming posts, whose purpose is to show governance by coercion, pressure, retribution and tribalism rather than professional relationship between human beings at the European Patent Office (EPO)



  18. Insensitivity at the EPO’s Management – Part VII: EPO Hypocrisy on Cancer and Lack of Feedback to and From ECPC

    The European Cancer Patient Coalition (ECPC), which calls itself "the largest European cancer patients' umbrella organisation," fails to fulfill its duties, says a source of ours, and the EPO makes things even worse



  19. Links 21/2/2017: KDE Plasma 5.9.2 in Chakra GNU/Linux, pfSense 2.3.3

    Links for the day



  20. EPO Caricature: Battistelli's Wall

    Battistelli's solution to everything at the EPO is exclusion and barriers



  21. The 'New' Microsoft is Still Acting Like a Dangerous Cult in an Effort to Hijack and/or Undermine All Free/Open Source Software

    In an effort to combat any large deployment of non-Microsoft software, the company goes personal and attempts to overthrow even management that is not receptive to Microsoft's agenda



  22. PTAB Petitioned to Help Against Patent Troll InfoGation Corp., Which Goes After Linux/Android OEMs in China

    A new example of software patents against Free software, or trolls against companies that are distributing freedom-respecting software from a country where these patents are not even potent (they don't exist there)



  23. Links 20/2/2017: Linux 4.10, LineageOS Milestone

    Links for the day



  24. No, Doing Mathematical Operations on a Processor Does Not Make Algorithms Patent-Eligible

    Old and familiar tricks -- a method for tricking examiners into the idea that algorithms are actual machines -- are being peddled by Watchtroll again



  25. Paid-for UPC Proponent, IAM 'Magazine', Debunked on UPC Again

    The impact of the corrupted (by EPO money) media goes further than one might expect and even 'borrows' out-of-date news in order to promote the UPC



  26. Lack of Justice in and Around the EPO Drawing Scrutiny

    The status of the EPO as an entity above the law (in Germany, the Netherlands, Switzerland and so on) is becoming the subject of press reports and staff is leaving in large numbers



  27. Links 19/2/2017: GParted 0.28.1, LibreOffice Donations Record

    Links for the day



  28. The EPO is Becoming an Embarrassment to Europe and a Growing Threat to the European Union

    The increasingly pathetic moves by Battistelli and the ever-declining image/status of the EPO (only 0% of polled stakeholders approve Battistelli's management) is causing damage to the reputation of the European Union, even if the EPO is not a European Union organ but an international one



  29. Patent Misconceptions Promoted by the Patent Meta-Industry

    Cherry-picking one's way into the perception of patent eligibility for software and the misguided belief that without patents there will be no innovation



  30. As the United States Shuts Its Door on Low-Quality Patents the Patent Trolls Move to Asia

    Disintegration of Intellectual Ventures (further shrinkage after losing software patents at CAFC), China's massive patent bubble, and Singapore's implicit invitation/facilitation of patent trolls (bubble economy)


CoPilotCo

RSS 64x64RSS Feed: subscribe to the RSS feed for regular updates

Home iconSite Wiki: You can improve this site by helping the extension of the site's content

Home iconSite Home: Background about the site and some key features in the front page

Chat iconIRC Channel: Come and chat with us in real time

CoPilotCo

Recent Posts