EditorsAbout the SiteComes vs. MicrosoftUsing This Web SiteSite ArchivesCredibility IndexOOXMLOpenDocumentPatentsNovellNews DigestSite NewsRSS

06.30.09

Microsoft’s Latest Benchmark Fraud

Posted in Database, Deception, Fraud, FUD, GNU/Linux, IBM, Marketing, Microsoft, Oracle, SUN, UNIX at 3:34 am by Dr. Roy Schestowitz

Lie: MS SQL Oracle fake compare

Summary: Microsoft’s advertising is still a scam and should be dealt with appropriately

EARLIER THIS MONTH we wrote about Microsoft coming under threat of lawsuits due to these very same practices. The victim of benchmark fraud was IBM at the time and this time it is Oracle.

One of our readers got us a scan of the advert (see above). “It’s kinda small,” he says, “but you might find it interesting.” Here is the benchmark the advert is mentioning. To quote: “New results from SAP show that on similarly configured systems, SQL Server 2000 running on Windows Server 2003 outperformed Oracle 9i running on HP-UX. The highest Fully Processed Line Items Per hour, 178,000, has SAP certification number 2005017, and the highest 4-way Oracle result in this benchmark is 88,670, with SAP certification number 2004030.

“Such benchmark fraud should be reported to the ASA for deceptive marketing.”They neglect to say that MSSQL server is 8 cores, whereas the Oracle server is 4 cores. Oiaohm adds that “HP-UX has the lowest benchmarks with Oracle. Solaris and Linux outscore it. Basically, Microsoft cheats on benchmarks at every chance. [...] Also thinking Oracle also runs on Windows. Benchmark was very incomplete. [...] Also lower clock speed processors.”

“It’s a really stacked config,” adds the person who sent us this information. “Even with it not being HPUX, you are looking at 4 dual-core Opterons versus 4 single-core Itanium2 processors. Quite a big speed difference too.”

To conclude, he adds: “The point was to show MSSQL was faster than Oracle. They want you to buy their database, not just the OS. It’s just one more effort on Microsoft’s part to spin bad data into a convincing glossy blurb to appeal to the C-levels I don’t mind if they do a fair comparison and win, but this kind of stuff just hurts their credibility.”

Such benchmark fraud should be reported to the ASA for deceptive marketing. This has happened before and the same should be done about “<vendor> recommends Vista” [1, 2] and other marketing schemes, maybe even “it’s better with Windows” [1, 2].

Microsoft keeps wondering why it is not liked in IT circles. It is not because “it’s a big company.”

“Microsoft did sponsor the benchmark testing and the NT server was better tuned than the Linux one. Having said that, I must say that I still trust the Windows NT server would have outperformed the Linux one.”

Windows platform manager, Microsoft South Africa
Reference: Outrage at Microsoft’s independent, yet sponsored NT 4.0/Linux research

Share this post: These icons link to social bookmarking sites where readers can share and discover new web pages.
  • Digg
  • del.icio.us
  • Reddit
  • co.mments
  • DZone
  • email
  • Google Bookmarks
  • LinkedIn
  • NewsVine
  • Print
  • Technorati
  • TwitThis
  • Facebook

If you liked this post, consider subscribing to the RSS feed or join us now at the IRC channels.

Pages that cross-reference this one

2 Comments

  1. Jose_X said,

    June 30, 2009 at 11:47 pm

    Gravatar

    I’ll repeat what I said here for the IBM lawsuit story http://www.eweekeurope.co.uk/news/ibm-goes-legal-over-microsoft-s-websphere-claims-1076
    *****
    Here is a simple recipe.

    Keep in mind this is a hypothetical exercise.

    We have two pieces of hardware: A (ours) and B (theirs).

    We have the corresponding platform software: for A (our platform sw) and for B (their platform sw).

    We have the product being tested on each (in this case, it’s their server software).

    The first step is to make sure we find an A so that it outperforms their B hardware. This is easy to do unless B is the fastest supercomputer on record. It isn’t, obviously, so we can definitely find an A that beats whatever B is. [Eg, a 4gighz x86 beats a 1gighz x86 from the same vendor.]

    Each platform software performs about the same as the other under ordinary circumstances (or maybe ours is a bit worse). This means we will optimize extra for the occasion. This is easy to do by removing security and other tests. We can keep special task/process related memory objects around preinitialized in anticipation. We can simplify and speed up our scheduling. We can give the special process high priority to the CPU and to the filesystem (bypassing security checks, etc). We put everything else, including the GUI, into slow low priority mode. We turn kernel dynamic lists into static lists. Etc. Really, it is possible to optimize well for the occasion if we know the system will only be used for a specific purpose (to win in some benchmark). Also, the platform software we chose for their side is their generic platform software if possible (eg, their regular platform software not optimized for this benchmark).

    So that is how we easily got the improved performance.

    However, we need to control further context in order to pull off the coop. What about the price, right? After all, a supercomputer outperforms a pocket calculator, but people don’t buy supercomputers to compute tax at the restaurant. The context in this case is that the supercomputer is a LOT MORE expensive. We need to get the price of our “supercomputer” down to a competitive level.

    Here is how we carry out this step. We work with the hardware partner. They develop an exclusive model that they will price near cost. We also give away our platform software at near cost (it’s a “special configuration” remember). Voila! We got our costs down because we and our partner have no intention to actually sell many of these models to actual customers.

    So we kick their buttocks, and customers flock to our product.

    Then…

    The hardware model runs out quickly and a very slightly differently named/numbered hardware model is put in its place at a higher price.

    Also, our platform software is changed back to normal, except that now, it actually doesn’t run their server software all that well in comparison to our own server software that competes with theirs (but which was not tested in the benchmark). It’s extremely easy to change platform software bits around so that one app that was favored is no longer favored and is actually handicapped. It’s also very difficult to catch this if third parties don’t have the source code. Also, for subtlety, this change in the platform can be achieved later on through one or more automatic online updates/patches.

    Of course, the price of the platform software also goes up eventually, if not initially. Maybe its price goes up at the one year renewal or else when they exceed an artificially low user count. Or perhaps the price is raised transparently through the bundled software/service package “deal” the customer actually ended up buying. There are many ways to guide them into these higher priced options.

    Profit.

    Recap: We found better hardware, tweaked only our platform software to game the benchmark, and artificially lowered the price on this model in order to win the benchmark price comparison test. Then we switched this system with a regular one, threw in some more items, and modified the platform software (over time) to disfavor their application that we favored for the benchmark. Through this bait and switch we won the contract, and later by controlling the platform software, we disgraced their product to upsell our product in its place. We had the slightly worse software perhaps yet won and pulled in much more money than what they were advertising as their price tag. A full sleigh of hand.

    This is dirty, absolutely. It’s deceptive. It’s anti-consumer and anti-competitive. It likely leverages monopolies later on in the upsell. It is perfectly within Microsoft’s capabilities to pull off. It would be consistent with Microsoft’s past behavior.

    Keep in mind, however, that this was only a hypothetical exercise.

    Jose_X Reply:

    I should point out that the scenarios are different because the stacks are different (in the IBM case, it was the same IBM product that was tested on two different platforms).

    What doesn’t change is the story about deception.. which is also a story about trust.

What Else is New


  1. Leaked: Meeting in Secret, Jesper Kongstad-Led Council Decides EPO Judge is Guilty Until Proven Innocent

    This EPO document, which came out earlier today, includes brief news on the suspended DG3 member (a judge whom Battistelli does not like); it’s not exactly encouraging as it’s not apparent that the situation will be resolved any time soon (before end of tenure)



  2. Deconstructing the Latest 'Damage Control' From Team UPC Amid Demise of Unitary Patent Pipe Dreams

    A breakdown of responses to Britain's exit from the EU (as per Article 50), with its mortal impact on the Unified Patent Court that was long envisioned and lobbied for by the patent microcosm



  3. As Expected, Photo Op and Battistelli Lies Have Just Come Out, Hilariously Claiming “Higher Quality Patent Procedures”

    A short time after Techrights covered the meeting in which Battistelli would likely attempt to co-opt Lee for legitimisation the EPO does exactly what we predicted it would do



  4. Oral Arguments in the US Supreme Court (SCOTUS) Suggest That the TC Heartland Case Will Likely Crush the Eastern District of Texas, Presently Infested With Patent Trolls

    Courts of the Eastern District of Texas (EDTX or East Texas for short) might soon have to fold or resize, and the local economy adapt to accommodate something other than patent trolls and aggressors, based on words (questions) heard at the highest courtroom in the United States



  5. Devaluation of European Patents is a Recipe for Institutional Suicide and Immeasurable Harm to Europe's Economy

    The horrible vision and the enormous cost (not just to the European Patent Office) that Battistelli's policies will have on an entire continent explained in light of the situation in China, where the biggest patent bubble in human history is currently taking shape



  6. EPO is a Laughing Stock in International Media This Week (Quality of Patents) After Decades-Long Reputation Building

    The reputation of European Patents (EPs) is quickly going down the drain, as Battistelli defies the law and the very fundamental principles of patenting



  7. Director Michelle Lee Across the Table From EPO 'Mafioso' Benoît Battistelli

    Battistelli leaves the comfort of his secret penthouse (paid for by EPO budget) and apparently goes to America where things have been improving, unlike the EPO



  8. Links 30/3/2017: Vivaldi 1.8, GNOME 3.26 Release Schedule

    Links for the day



  9. Recognising the Death of Software Patents, Microsoft's Largest Ally in India Belatedly Joins the Linux-Centric Open Invention Network

    With the demise of software patents come some interesting new developments, including the decision at Infosys — historically very close to Microsoft and a proponent of software patents — to join the Open Invention Network (OIN)



  10. LG Not Only Suing Rivals Using Patents But is Also Passing Patents for Trolls Like Sentegra to Sue

    LG gives yet more reasons for a boycott, having just leveraged not just patents but also patent trolls in a battle against a competitor



  11. March 29th: The Day the Unitary Patent (UPC) Died

    Stating the obvious and proving us right amid Article 50 débâcle



  12. Kongstad and Battistelli Have Staged a Coup at the European Patent Organisation (EPO)

    Discussion about Battistelli and his chinchilla denying national representatives their rights and power to oust Battistelli, who is rapidly destroying not just the Office but also the whole Organisation, Europe's reputation, and the image of France



  13. Europe as the World's Laughing Stock When it Comes to Patent Quality/Scope and the Coming Appeals

    Criticism and embarrassing coverage for the EPO, which has just decided to grant patents even on genome, in defiance of a lot of things



  14. Links 29/3/2017: End of Linux Action Show, Top NSA Partner Pays Linux Foundation

    Links for the day



  15. In Attempt to Promote the Horrific UPC (Poor Quality of Patents Everywhere), Minnoye and Casado Cerviño Attack Their Own Staff for Saying the Truth

    An attack on truth itself -- the disintegration of the European Patent Office (EPO) -- carries on, after staff found the courage to tell delegates what had happened due to Battistelli's policies and incredible oppression that prevails and expands



  16. Another Likely Casualty of the Battistelli Regime at the EPO: Validity of Decisions of Terrified Boards of Appeal Judges

    Under pressure and habitual intervention from a demoralising, overreaching, and out-of-control President (from an entirely different division), examiners and judges 'normalise' the practice of granting patents on genetics -- a very slippery slope in terms of patent scope



  17. Benoît Battistelli 'Pulls an Erdoğan' Faster Than Erdoğan

    An explanation of what the imminent departure of Minnoye (this summer) will mean for Benoît Battistelli and his confidants, who now resemble some of the world's most ruthless dictatorships



  18. With Important Supreme Court Decisions Looming, Mainstream Media Tackles Patent Trolls

    The US Supreme Court (SCOTUS) will soon rule on TC Heartland and Lexmark, potentially restricting abusive patent behaviour even further (making room for freedom to innovate and for competition)



  19. IAM Magazine is Very Blatantly Promoting Patent Trolls and Their Agenda

    IAM Media, which produces a magazine every now and then while posting online every day, maintains its pro-trolls agenda, which is becoming so clear to see that it is definitely worth documenting yet again



  20. A “Perfect Recipe for Fraud” at the European Patent Office (EPO)

    How the world's leading patent office became a world-leading source of abuse, corruption, nepotism, injustice, incompetence, censorship, alleged bribery, pure deception, distortion of media, defamation, and suicides (among many other things)



  21. Techrights Was Right About the Unitary Patent (UPC)

    No Unified Patent Court in the UK and probably nothing like it in the rest of Europe any time soon (if ever)



  22. Patents on Life and Patents on Software Serve to Show That EPO Patent Quality Fell Well Behind the US (PTO)

    Anything goes at the EPO, except dissent; any patent application seems to be grantable, provided one uses simple tricks and persists against overworked examiners who are pressured to increase so-called 'production'



  23. Links 28/3/2017: Linux 4.11-rc4 Kernel Released, Red Hat Surge on Sales

    Links for the day



  24. The Crook Goes to Brussels to Lie About the Unitary Patent (UPC)

    The person who spent years lying about the UPC and severely attacking critics (usually by blatantly lying about them) goes to Brussels for another nose extension



  25. The EPO's HR Roadmap Retrospective

    A look back at the terrible ‘accomplishments’ of the Jesper Kongstad-led Administrative Council, which still issues hogwash and face-saving lies, as one might expect from a protector of Battistelli that lies to national representatives and buries inconvenient topics



  26. Links 26/3/2017: Debian Project Leader Elections, SecureDrop and Alexandre Oliva FSF Winners

    Links for the day



  27. His Master's Voice, Jesper Kongstad, Blocks Discussion of Investigative and Disciplinary Procedures at the EPO

    The Chairman of the Administrative Council of the European Patent Organisation is actively preventing not just the dismissal of Battistelli but also discussion of Battistelli's abuses



  28. Heiko Maas and the State of Germany Viewed as Increasingly Complicit in EPO Scandals and Toxic UPC Agenda

    It is becoming hard if not impossible to interpret silence and inaction from Maas as a form of endorsement for everything the EPO has been doing, with the German delegates displaying more of that apathy which in itself constitutes a form of complicity



  29. With IP Kat Coverage of EPO Scandals Coming to an End (Officially), Techrights and The Register Remain to Cover New Developments

    One final post about the end of Merpel’s EPO coverage, which is unfortunate but understandable given the EPO’s track record attacking the media, including blogs like IP Kat, sites of patent stakeholders, and even so-called media partners



  30. Everyone, Including Patent Law Firms, Will Suffer From the Demise of the EPO

    Concerns about quality of patents granted by the EPO (EPs) are publicly raised by industry/EPO insiders, albeit in an anonymous fashion


CoPilotCo

RSS 64x64RSS Feed: subscribe to the RSS feed for regular updates

Home iconSite Wiki: You can improve this site by helping the extension of the site's content

Home iconSite Home: Background about the site and some key features in the front page

Chat iconIRC Channel: Come and chat with us in real time

CoPilotCo

Recent Posts