EditorsAbout the SiteComes vs. MicrosoftUsing This Web SiteSite ArchivesCredibility IndexOOXMLOpenDocumentPatentsNovellNews DigestSite NewsRSS

06.30.09

Microsoft’s Latest Benchmark Fraud

Posted in Database, Deception, Fraud, FUD, GNU/Linux, IBM, Marketing, Microsoft, Oracle, SUN, UNIX at 3:34 am by Dr. Roy Schestowitz

Lie: MS SQL Oracle fake compare

Summary: Microsoft’s advertising is still a scam and should be dealt with appropriately

EARLIER THIS MONTH we wrote about Microsoft coming under threat of lawsuits due to these very same practices. The victim of benchmark fraud was IBM at the time and this time it is Oracle.

One of our readers got us a scan of the advert (see above). “It’s kinda small,” he says, “but you might find it interesting.” Here is the benchmark the advert is mentioning. To quote: “New results from SAP show that on similarly configured systems, SQL Server 2000 running on Windows Server 2003 outperformed Oracle 9i running on HP-UX. The highest Fully Processed Line Items Per hour, 178,000, has SAP certification number 2005017, and the highest 4-way Oracle result in this benchmark is 88,670, with SAP certification number 2004030.

“Such benchmark fraud should be reported to the ASA for deceptive marketing.”They neglect to say that MSSQL server is 8 cores, whereas the Oracle server is 4 cores. Oiaohm adds that “HP-UX has the lowest benchmarks with Oracle. Solaris and Linux outscore it. Basically, Microsoft cheats on benchmarks at every chance. [...] Also thinking Oracle also runs on Windows. Benchmark was very incomplete. [...] Also lower clock speed processors.”

“It’s a really stacked config,” adds the person who sent us this information. “Even with it not being HPUX, you are looking at 4 dual-core Opterons versus 4 single-core Itanium2 processors. Quite a big speed difference too.”

To conclude, he adds: “The point was to show MSSQL was faster than Oracle. They want you to buy their database, not just the OS. It’s just one more effort on Microsoft’s part to spin bad data into a convincing glossy blurb to appeal to the C-levels I don’t mind if they do a fair comparison and win, but this kind of stuff just hurts their credibility.”

Such benchmark fraud should be reported to the ASA for deceptive marketing. This has happened before and the same should be done about “<vendor> recommends Vista” [1, 2] and other marketing schemes, maybe even “it’s better with Windows” [1, 2].

Microsoft keeps wondering why it is not liked in IT circles. It is not because “it’s a big company.”

“Microsoft did sponsor the benchmark testing and the NT server was better tuned than the Linux one. Having said that, I must say that I still trust the Windows NT server would have outperformed the Linux one.”

Windows platform manager, Microsoft South Africa
Reference: Outrage at Microsoft’s independent, yet sponsored NT 4.0/Linux research

Share this post: These icons link to social bookmarking sites where readers can share and discover new web pages.
  • Digg
  • del.icio.us
  • Reddit
  • co.mments
  • DZone
  • email
  • Google Bookmarks
  • LinkedIn
  • NewsVine
  • Print
  • Technorati
  • TwitThis
  • Facebook

If you liked this post, consider subscribing to the RSS feed or join us now at the IRC channels.

Pages that cross-reference this one

2 Comments

  1. Jose_X said,

    June 30, 2009 at 11:47 pm

    Gravatar

    I’ll repeat what I said here for the IBM lawsuit story http://www.eweekeurope.co.uk/news/ibm-goes-legal-over-microsoft-s-websphere-claims-1076
    *****
    Here is a simple recipe.

    Keep in mind this is a hypothetical exercise.

    We have two pieces of hardware: A (ours) and B (theirs).

    We have the corresponding platform software: for A (our platform sw) and for B (their platform sw).

    We have the product being tested on each (in this case, it’s their server software).

    The first step is to make sure we find an A so that it outperforms their B hardware. This is easy to do unless B is the fastest supercomputer on record. It isn’t, obviously, so we can definitely find an A that beats whatever B is. [Eg, a 4gighz x86 beats a 1gighz x86 from the same vendor.]

    Each platform software performs about the same as the other under ordinary circumstances (or maybe ours is a bit worse). This means we will optimize extra for the occasion. This is easy to do by removing security and other tests. We can keep special task/process related memory objects around preinitialized in anticipation. We can simplify and speed up our scheduling. We can give the special process high priority to the CPU and to the filesystem (bypassing security checks, etc). We put everything else, including the GUI, into slow low priority mode. We turn kernel dynamic lists into static lists. Etc. Really, it is possible to optimize well for the occasion if we know the system will only be used for a specific purpose (to win in some benchmark). Also, the platform software we chose for their side is their generic platform software if possible (eg, their regular platform software not optimized for this benchmark).

    So that is how we easily got the improved performance.

    However, we need to control further context in order to pull off the coop. What about the price, right? After all, a supercomputer outperforms a pocket calculator, but people don’t buy supercomputers to compute tax at the restaurant. The context in this case is that the supercomputer is a LOT MORE expensive. We need to get the price of our “supercomputer” down to a competitive level.

    Here is how we carry out this step. We work with the hardware partner. They develop an exclusive model that they will price near cost. We also give away our platform software at near cost (it’s a “special configuration” remember). Voila! We got our costs down because we and our partner have no intention to actually sell many of these models to actual customers.

    So we kick their buttocks, and customers flock to our product.

    Then…

    The hardware model runs out quickly and a very slightly differently named/numbered hardware model is put in its place at a higher price.

    Also, our platform software is changed back to normal, except that now, it actually doesn’t run their server software all that well in comparison to our own server software that competes with theirs (but which was not tested in the benchmark). It’s extremely easy to change platform software bits around so that one app that was favored is no longer favored and is actually handicapped. It’s also very difficult to catch this if third parties don’t have the source code. Also, for subtlety, this change in the platform can be achieved later on through one or more automatic online updates/patches.

    Of course, the price of the platform software also goes up eventually, if not initially. Maybe its price goes up at the one year renewal or else when they exceed an artificially low user count. Or perhaps the price is raised transparently through the bundled software/service package “deal” the customer actually ended up buying. There are many ways to guide them into these higher priced options.

    Profit.

    Recap: We found better hardware, tweaked only our platform software to game the benchmark, and artificially lowered the price on this model in order to win the benchmark price comparison test. Then we switched this system with a regular one, threw in some more items, and modified the platform software (over time) to disfavor their application that we favored for the benchmark. Through this bait and switch we won the contract, and later by controlling the platform software, we disgraced their product to upsell our product in its place. We had the slightly worse software perhaps yet won and pulled in much more money than what they were advertising as their price tag. A full sleigh of hand.

    This is dirty, absolutely. It’s deceptive. It’s anti-consumer and anti-competitive. It likely leverages monopolies later on in the upsell. It is perfectly within Microsoft’s capabilities to pull off. It would be consistent with Microsoft’s past behavior.

    Keep in mind, however, that this was only a hypothetical exercise.

    Jose_X Reply:

    I should point out that the scenarios are different because the stacks are different (in the IBM case, it was the same IBM product that was tested on two different platforms).

    What doesn’t change is the story about deception.. which is also a story about trust.

What Else is New


  1. Team UPC is Interjecting Itself Into the Media Ahead of Tomorrow's Lobbying Push Against the European Council and Against European Interests

    A quick look at the growing bulk of UPC lobbying (by the legal firms which stand to benefit from it) ahead of tomorrow's European Council meeting which is expected to discuss a unitary patent system



  2. IP Kat is Lobbying Heavily for the UPC, Courtesy of Team UPC

    When does an IP (or patent) blog become little more than an aggregation of interest groups and self-serving patent law firms, whose agenda overlaps that of Team Battistelli?



  3. Leaked: Conclusions of the Secretive EPO Board 28 Meeting (8th of September 2016)

    The agenda and outcome of the secretive meeting of the Board of the Administrative Council of the EPO



  4. Letter From the Dutch Institute of Patent Attorneys (Nederlandse Orde van Octrooigemachtigden) to the Administrative Council of the EPO

    The Netherlands Institute of Patent Attorneys, a group representing a large number of Dutch patent practitioners, is against Benoît Battistelli and his horrible behaviour at the European Patent Office (EPO)



  5. EPO's Board 28 Notes Battistelli's “Three Current Investigations/Disciplinary Proceedings Involving SUEPO Members in The Hague."

    The attack on SUEPO (EPO staff representatives) at The Hague appears to have been silently expanded to a third person, showing an obvious increase in Battistelli's attacks on truth-tellers



  6. Links 28/9/2016: Alpine Linux 3.4.4, Endless OS 3.0

    Links for the day



  7. Cementing Autocracy: The European Patent Office Against Democracy, Against Media, and Against the Rule of Law

    The European Patent Office (EPO) actively undermines democracy in Europe, it undermines the freedom of the press (by paying it for puff pieces), and it undermines the rule of law by giving one single tyrant total power in Eponia and immunity from outside Eponia (even when he breaks his own rules)



  8. Links 28/9/2016: New Red Hat Offices, Fedora 25 'Frozen'

    Links for the day



  9. Team Battistelli Intensifies the Attack on the Boards of Appeal Again

    The lawless state of the EPO, where the rule of law is basically reducible to Battistelli's ego and insecurities, is again demonstrated with an escalation and perhaps another fake 'trial' in the making (after guilt repeatedly fails to be established)



  10. After the EPO Paid the Financial Times to Produce Propaganda the Newspaper Continues to Produce UPC Puff Pieces, Just Ahead of EU Council Meeting

    How the media, including the Financial Times, has been used (and even paid!) by the EPO in exchange for self-serving (to the EPO) messages and articles



  11. Beware the Patent Law Firms Insinuating That Software Patents Are Back Because of McRO

    By repeatedly claiming (and then generalising) that CAFC accepted a software patent the patent microcosm (meta-industry) hopes to convince us that we should continue to pursue software patents in the US, i.e. pay them a lot more money for something of little/no value



  12. The US Supreme Court Might Soon Tighten Patent Scope in the United States Even Further, the USPTO Produces Patent Maximalism Propaganda

    A struggle brewing between the patent 'industry' (profiting from irrational saturation) and the highest US court, as well as the Government Accountability Office (GAO)



  13. Patent Trolling a Growing Problem in East Asia (Software Patents Also), Whereas in the US the Problem Goes Away Along With Software Patents

    A look at two contrasting stories, one in Asia where patent litigation and hype are on the rise (same in Europe due to the EPO) and another in the US where a lot of patents face growing uncertainty and a high invalidation rate



  14. The EPO's Continued Push for Software Patents, Marginalisation of Appeals (Reassessment), and Deviation From the EPC

    A roundup of new developments at the EPO, where things further exacerbate and patent quality continues its downward spiral



  15. The Battistelli Effect: “We Will be Gradually Forced to File Our Patent Applications Outside the EPO in the Interests of Our Clients”

    While the EPO dusts off old files and grants in haste without quality control (won't be sustainable for more than a couple more years) the applicants are moving away as trust in the EPO erodes rapidly and profoundly



  16. Links 27/9/2016: Lenovo Layoffs, OPNFV Third Software Release

    Links for the day



  17. The Moral Depravity of the European Patent Office Under Battistelli

    The European Patent Office (EPO) comes under heavy criticism from its very own employees, who also seem to recognise that lobbying for the UPC is a very bad idea which discredits the European Patent Organisation



  18. Links 26/9/2016: Linux 4.8 RC8, SuperTux 0.5

    Links for the day



  19. What Insiders Are Saying About the Sad State of the European Patent Office (EPO)

    Anonymous claims made by people who are intimately familiar with the European Patent Office (from the inside) shed light on how bad things have become



  20. The EPO Does Not Want Skilled (and 'Expensive') Staff, Layoffs a Growing Concern

    A somewhat pessimistic look (albeit increasingly realistic look) at the European Patent Office, where unions are under fire for raising legitimate concerns about the direction taken by the management since a largely French team was put in charge



  21. Patents Roundup: Accenture Software Patents, Patent Troll Against Apple, Willful Infringements, and Apple Against a Software Patent

    A quick look at various new articles of interest (about software patents) and what can be deduced from them, especially now that software patents are the primary barrier to Free/Libre Open Source software adoption



  22. Software Patents Propped Up by Patent Law Firms That Are Lying, Further Assisted by Rogue Elements Like David Kappos and Randall Rader (Revolving Doors)

    The sheer dishonesty of the patent microcosm (seeking to bring back software patents by misleading the public) and those who are helping this microcosm change the system from the inside, owing to intimate connections from their dubious days inside government



  23. Links 25/9/2016: Linux 4.7.5, 4.4.22; LXQt 0.11

    Links for the day



  24. Patent Quality and Patent Scope the Unspeakable Taboo at the EPO, as Both Are Guillotined by Benoît Battistelli for the Sake of Money

    The gradual destruction of the European Patent Office (EPO), which was once unanimously regarded as the world's best, by a neo-liberal autocrat from France, Benoît Battistelli



  25. Bristows LLP's Hatred/Disdain of UK/EU Democracy Demonstrated; Says “Not Only Will the Pressure for UK Ratification of the UPC Agreement Continue, But a Decision is Wanted Within Weeks.”

    Without even consulting the British public or the European public (both of whom would be severely harmed by the UPC), the flag bearers of the UPC continue to bamboozle and then pressure politicians, public servants and nontechnical representatives



  26. Released Late on a Friday, EPO Social 'Study' (Battistelli-Commissioned Propaganda) Attempts to Blame Staff for Everything

    The longstanding propaganda campaign (framing staff as happy or framing unhappy staff as a disgruntled minority) is out and the timing of the release is suspicious to say the least



  27. Links 23/9/2016: Latest Microsoft and Lenovo Spin (Now in ‘Damage Control’ Mode)

    Links for the day



  28. White Male-Dominated EPO Management Sinks to New Lows, Again

    Benoît Battistelli continues to make the EPO look like Europe's biggest laughing stock by attempting to tackle issues with corny photo ops rather than real change (like SUEPO recognition, diverse hiring, improved patent quality, and cessation of sheer abuses)



  29. Journalism 102: Do Not Become Like 'Managing IP' or IAM 'Magazine' (the Megaphones of the EPO’s Management)

    Another look at convergence between media and the EPO, which is spending virtually millions of Euros literally buying the media and ensuring that the EPO's abuses are scarcely covered (if ever mentioned at all)



  30. Journalism 101: Do Not Believe Anything That Benoît Battistelli and the EPO's Management Say (Also Don't Fall for the UPC Hype)

    A survey/review (or an overview) of recent articles about the EPO and why they're wrong (mostly because they parrot the official lies from Battistelli's department)


CoPilotCo

RSS 64x64RSS Feed: subscribe to the RSS feed for regular updates

Home iconSite Wiki: You can improve this site by helping the extension of the site's content

Home iconSite Home: Background about the site and some key features in the front page

Chat iconIRC Channel: Come and chat with us in real time

CoPilotCo

Recent Posts