EditorsAbout the SiteComes vs. MicrosoftUsing This Web SiteSite ArchivesCredibility IndexOOXMLOpenDocumentPatentsNovellNews DigestSite NewsRSS

06.30.09

Microsoft’s Latest Benchmark Fraud

Posted in Database, Deception, Fraud, FUD, GNU/Linux, IBM, Marketing, Microsoft, Oracle, SUN, UNIX at 3:34 am by Dr. Roy Schestowitz

Lie: MS SQL Oracle fake compare

Summary: Microsoft’s advertising is still a scam and should be dealt with appropriately

EARLIER THIS MONTH we wrote about Microsoft coming under threat of lawsuits due to these very same practices. The victim of benchmark fraud was IBM at the time and this time it is Oracle.

One of our readers got us a scan of the advert (see above). “It’s kinda small,” he says, “but you might find it interesting.” Here is the benchmark the advert is mentioning. To quote: “New results from SAP show that on similarly configured systems, SQL Server 2000 running on Windows Server 2003 outperformed Oracle 9i running on HP-UX. The highest Fully Processed Line Items Per hour, 178,000, has SAP certification number 2005017, and the highest 4-way Oracle result in this benchmark is 88,670, with SAP certification number 2004030.

“Such benchmark fraud should be reported to the ASA for deceptive marketing.”They neglect to say that MSSQL server is 8 cores, whereas the Oracle server is 4 cores. Oiaohm adds that “HP-UX has the lowest benchmarks with Oracle. Solaris and Linux outscore it. Basically, Microsoft cheats on benchmarks at every chance. [...] Also thinking Oracle also runs on Windows. Benchmark was very incomplete. [...] Also lower clock speed processors.”

“It’s a really stacked config,” adds the person who sent us this information. “Even with it not being HPUX, you are looking at 4 dual-core Opterons versus 4 single-core Itanium2 processors. Quite a big speed difference too.”

To conclude, he adds: “The point was to show MSSQL was faster than Oracle. They want you to buy their database, not just the OS. It’s just one more effort on Microsoft’s part to spin bad data into a convincing glossy blurb to appeal to the C-levels I don’t mind if they do a fair comparison and win, but this kind of stuff just hurts their credibility.”

Such benchmark fraud should be reported to the ASA for deceptive marketing. This has happened before and the same should be done about “<vendor> recommends Vista” [1, 2] and other marketing schemes, maybe even “it’s better with Windows” [1, 2].

Microsoft keeps wondering why it is not liked in IT circles. It is not because “it’s a big company.”

“Microsoft did sponsor the benchmark testing and the NT server was better tuned than the Linux one. Having said that, I must say that I still trust the Windows NT server would have outperformed the Linux one.”

Windows platform manager, Microsoft South Africa
Reference: Outrage at Microsoft’s independent, yet sponsored NT 4.0/Linux research

Share this post: These icons link to social bookmarking sites where readers can share and discover new web pages.
  • Digg
  • del.icio.us
  • Reddit
  • co.mments
  • DZone
  • email
  • Google Bookmarks
  • LinkedIn
  • NewsVine
  • Print
  • Technorati
  • TwitThis
  • Facebook

If you liked this post, consider subscribing to the RSS feed or join us now at the IRC channels.

Pages that cross-reference this one

2 Comments

  1. Jose_X said,

    June 30, 2009 at 11:47 pm

    Gravatar

    I’ll repeat what I said here for the IBM lawsuit story http://www.eweekeurope.co.uk/news/ibm-goes-legal-over-microsoft-s-websphere-claims-1076
    *****
    Here is a simple recipe.

    Keep in mind this is a hypothetical exercise.

    We have two pieces of hardware: A (ours) and B (theirs).

    We have the corresponding platform software: for A (our platform sw) and for B (their platform sw).

    We have the product being tested on each (in this case, it’s their server software).

    The first step is to make sure we find an A so that it outperforms their B hardware. This is easy to do unless B is the fastest supercomputer on record. It isn’t, obviously, so we can definitely find an A that beats whatever B is. [Eg, a 4gighz x86 beats a 1gighz x86 from the same vendor.]

    Each platform software performs about the same as the other under ordinary circumstances (or maybe ours is a bit worse). This means we will optimize extra for the occasion. This is easy to do by removing security and other tests. We can keep special task/process related memory objects around preinitialized in anticipation. We can simplify and speed up our scheduling. We can give the special process high priority to the CPU and to the filesystem (bypassing security checks, etc). We put everything else, including the GUI, into slow low priority mode. We turn kernel dynamic lists into static lists. Etc. Really, it is possible to optimize well for the occasion if we know the system will only be used for a specific purpose (to win in some benchmark). Also, the platform software we chose for their side is their generic platform software if possible (eg, their regular platform software not optimized for this benchmark).

    So that is how we easily got the improved performance.

    However, we need to control further context in order to pull off the coop. What about the price, right? After all, a supercomputer outperforms a pocket calculator, but people don’t buy supercomputers to compute tax at the restaurant. The context in this case is that the supercomputer is a LOT MORE expensive. We need to get the price of our “supercomputer” down to a competitive level.

    Here is how we carry out this step. We work with the hardware partner. They develop an exclusive model that they will price near cost. We also give away our platform software at near cost (it’s a “special configuration” remember). Voila! We got our costs down because we and our partner have no intention to actually sell many of these models to actual customers.

    So we kick their buttocks, and customers flock to our product.

    Then…

    The hardware model runs out quickly and a very slightly differently named/numbered hardware model is put in its place at a higher price.

    Also, our platform software is changed back to normal, except that now, it actually doesn’t run their server software all that well in comparison to our own server software that competes with theirs (but which was not tested in the benchmark). It’s extremely easy to change platform software bits around so that one app that was favored is no longer favored and is actually handicapped. It’s also very difficult to catch this if third parties don’t have the source code. Also, for subtlety, this change in the platform can be achieved later on through one or more automatic online updates/patches.

    Of course, the price of the platform software also goes up eventually, if not initially. Maybe its price goes up at the one year renewal or else when they exceed an artificially low user count. Or perhaps the price is raised transparently through the bundled software/service package “deal” the customer actually ended up buying. There are many ways to guide them into these higher priced options.

    Profit.

    Recap: We found better hardware, tweaked only our platform software to game the benchmark, and artificially lowered the price on this model in order to win the benchmark price comparison test. Then we switched this system with a regular one, threw in some more items, and modified the platform software (over time) to disfavor their application that we favored for the benchmark. Through this bait and switch we won the contract, and later by controlling the platform software, we disgraced their product to upsell our product in its place. We had the slightly worse software perhaps yet won and pulled in much more money than what they were advertising as their price tag. A full sleigh of hand.

    This is dirty, absolutely. It’s deceptive. It’s anti-consumer and anti-competitive. It likely leverages monopolies later on in the upsell. It is perfectly within Microsoft’s capabilities to pull off. It would be consistent with Microsoft’s past behavior.

    Keep in mind, however, that this was only a hypothetical exercise.

    Jose_X Reply:

    I should point out that the scenarios are different because the stacks are different (in the IBM case, it was the same IBM product that was tested on two different platforms).

    What doesn’t change is the story about deception.. which is also a story about trust.

What Else is New


  1. Links 24/8/2016: More From LinuxCon, Uganda Wants FOSS

    Links for the day



  2. Links 23/8/2016: GNOME 3.22 Beta, Android 7.0 Nougat

    Links for the day



  3. The Linux Foundation Gives Microsoft (Paid-for) Keynote Position While Microsoft Extorts (With Patents) Lenovo and Motorola Over Linux Use

    This morning's reminder that Nadella is just another Ballmer (with a different face); Motorola and Lenovo surrender to Microsoft's patent demands and will soon put Microsoft spyware/malware on their Linux-powered products to avert costly legal battles



  4. Not Just President Battistelli: EPO Vice-Presidents Are Still Intentionally Misrepresenting EPO Staff

    Evidence serving to show that EPO Vice-Presidents are still intentionally misrepresenting EPO staff representatives and misleading everyone in order to defend Battistelli



  5. Battistelli the Liar Causes a Climate of Confrontation in French Politics, Lies About Patent Quality (Among Many Other Things)

    Battistelli's lies are coming under increased scrutiny inside and outside the European Patent Office (EPO), where patent quality has been abandoned in order to artificially elevate figures



  6. The Collapse of Software Patents and Patent Law Firms Trying to “Overcome” Alice

    The United States continues its gradual crackdown on software patents (which are viewed as abstract and thus unpatentable), whereas in Europe things are murkier than ever



  7. Apple's Patent Wars Against Android/Linux Make Patent Trolls Stronger

    Apple's insistence that designs should be patentable could prove to be collectively expensive, as patent trolls would then use a possible SCOTUS nod to launch litigation campaigns



  8. Links 22/8/2016: Linux 4.8 RC3, Linux Mint 18 “Sarah” KDE Beta

    Links for the day



  9. Links 21/8/2016: Apple and Microsoft Down, Systemd Spreading to Mount

    Links for the day



  10. Links 20/8/2016: Android Domination, FSFE summit 2016

    Links for the day



  11. Patents Roundup: Trolls Dominate Litigation, PTAB Crushes Patents, Patent Box Regime Persists, and OIN Explains Itself

    Another roundup of patent news from around the Web with special focus on software patenting



  12. The Cost/Toll of the 'New' EPO and Where All That Money Goes or Comes From

    The European Patent Office has become a servant of the rich and powerful (including large foreign corporations) and even its own employees now pay the price associated with misguided new policies (or 'reforms' as Battistelli habitually refers to these)



  13. Links 19/8/2016: Linux Mint With KDE, Linux Foundation's PNDA

    Links for the day



  14. The End of an Era at the USPTO as Battistelli-Like (EPO) Granting Policies Are Over

    The United States is seeing the potency of patents -- especially software patents (which make up much of the country's troll cases) -- challenged by courts and by the Patent Trial and Appeal Board (PTAB)



  15. Battistelli's European Patent Office Goes to the United States to Speak About the UPC and Software Patents

    The European Patent Office is showing its utter contempt -- not just disregard -- for the very fundamental rules that put it in its place and brought it into existence



  16. Turkey Subjected to the European Patent Convention (EPC) But Benoît Battistelli is Not?

    The ‘constitutional crisis’ at the European Patent Office in the context of Turkey, which has signed "the EPC and as such recognises the competence and the decisions of the institutions which have been introduced in the convention."



  17. Links 18/8/2016: EFF Slams Vista 10, Linux Foundation Makes PNDA

    Links for the day



  18. Links 17/8/2016: GNOME and Debian Anniversaries

    Links for the day



  19. Personal Audio LLC and Patent Troll Jim Logan Demonstrate the Harms of Software Patents and Why They Must Never Spread to Europe

    Jim Logan of Personal Audio (a notorious Texas-based patent troll) is still fighting with his bogus patent, having already caused enormous damage with a single software patent that should never have been granted in the first place (due to prior art, not just Alice)



  20. The Patent Microcosm Hopes That the Originators of Software Patents Will Undermine the Patent Trial and Appeal Board

    Now that the actions of the Patent Trial and Appeal Board (PTAB), which have been consistently upheld by the CAFC in precedential decisions, are suddenly being questioned the patent microcosm gets all giddy and tries to undermine PTAB (again)



  21. That Time When the Administrative Council Helped Battistelli Crush Oversight (Audit Committee) and What ILO Said About It a Month Ago

    Things are becoming ever more troublesome at the EPO as the Administrative Council enjoys inaction from the International Labour Organization (ILO), in spite of its role in destroying much-needed oversight at the behest of Battistelli



  22. The EPO's Administrative Council Keeps Postponing Debate About Grounds for Firing the President

    A recollection of events prior to the latest Administrative Council meeting, where Benoît Battistelli's failings and accountability for failing to correct them never even came up



  23. A Surge of Staff Complaints About the European Patent Office Drowns the System, Disservice to Justice Noted

    Self-explanatory graphs about the state of the justice [sic] system which is prejudiced towards/against EPO workers, based on internal reports



  24. Links 16/8/2016: White House Urged by EFF on FOSS, Go 1.7 Released

    Links for the day



  25. Links 15/8/2016: Linux 4.8 RC2, Glimpses at OpenMandriva Lx 3.0

    Links for the day



  26. Clawing Back the Staff Benefits at the European Patent Office (EPO)

    Staff of the EPO is leaving (or retiring) in droves as abusive management continues to be the norm and staff benefits are being taken away or gradually revoked



  27. The Patent Microcosm is Panicking and Spinning Alice/§ 101 Because US Software Patents Are Still Dying

    A look at recent developments in the software patents scene in the United States, with increased focus on (or fear of) the Patent Trial and Appeal Board



  28. 21,000 Posts in Techrights in Less Than a Decade

    This post is the 21,000th post and the next one will make it more than twenty-one thousand posts in total. We are turning 10 in November.



  29. Patent Microcosm Shuts Out the Poor: Unified Patent Court (UPC) Promotion by Practising Law Institute (PLI) Only for the Wealthy

    The people who are profiting from patent feuds, disputes, lawsuits etc. are still trying to muscle their will into European law and they keep the general public out of it by locking down (or pricing out of reach) their meetings where they influence/lobby decision-making officials



  30. The United States Has a Growing Patent Trolls Epidemic as Very High Proportion of Lawsuits Filed by Them

    A look at the high proportion of patent lawsuits that are filed by entities that make nothing at all and thus serve no role whatsoever in innovation


CoPilotCo

RSS 64x64RSS Feed: subscribe to the RSS feed for regular updates

Home iconSite Wiki: You can improve this site by helping the extension of the site's content

Home iconSite Home: Background about the site and some key features in the front page

Chat iconIRC Channel: Come and chat with us in real time

CoPilotCo

Recent Posts