01.16.10

Lies and Denial of Service Attacks from Microsoft Bing

Posted in Deception, Google, Microsoft, Search at 5:56 am by Dr. Roy Schestowitz

Summary: Microsoft-rewarded companies hail Bing while it’s said to be down; crucial Perl services go down after MSNBOT goes out of control

EVERY firm that provides US-only statistics on search engines seems to be showing Microsoft's Bing on the decline (for December 2009). There is one exception. comScore, which is a Microsoft partner [1, 2, 3, 4, 5, 6, 7], contradicts the rest of the bunch, including Nielsen and Hitwise. This shows either that they are inaccurate or that there is a bias somewhere, favouring Microsoft at comScore (comScore is being paid by Microsoft and it cannot be trusted once its employees accept money from the very same company whose performance they assess in comparison to others’).

The only thing they all agree on is that Google continues to gain.

Nielsen, Hitwise, and comScore are all in agreement, so onlookers can perhaps declare it official now: Google had a good December. comScore, the member of the trio that most recently released its search market data, didn’t put Google up by a whole lot, though, and unlike the other firms, saw Bing gain ground.

The Bing-sponsored blog continues to show its bias and it says nothing about the fact that Microsoft is just buying some market share. Verizon is paid by Microsoft for example [1, 2]. So there are two issues here:

  1. Microsoft paid comScore, which is now contradicting Nielsen and Hitwise when it claims Microsoft gains
  2. Microsoft pays companies to remove Google as an option while blogs that it pays are claiming gains, describing that as success without mentioning those incentives (allegedly as much as $500,000,000 was paid to Verizon alone, in order to remove Google, despite customers’ preference)

It is worth adding that the same Microsoft-rewarded blog shares some Xbox 360 sales figures (US-only, even though this is not mentioned in the headline); these show Nintendo completely smashing Microsoft. Why not show global figures? Why not explicitly mention and emphasise that the figures refer only to one country? It is Microsoft’s home country where it battles against Japanese companies.

“MSNBOT must die!” says the Perl blog, which complains about Microsoft’s bad bots overwhelming the server due to shoddy code. Even CPAN was affected.

If you’ve suffered any problems accessing any of the sites, the databases, the CPAN mirror, etc from the CPAN Testers server last night, please direct your wrath at Microsoft. Last night the msnbot took out the CPAN Testers server with a dedicated denial of service attack. As a consequence measures are now being put in place to completely ban the msnbot from accessing at least the Reports site, and probably all the sites on the server.

Microsoft in their incompetent wisdom decided to unleash 20-30 bots every few seconds. I know this because I can see the IP addresses in the logs. The ones spotted within a few minutes of rebooting the server this morning to clear the processes were

Microsoft can’t even implement search right. An engine that’s estimated to handle just 3% of the world’s web search is causing far too much damage for far too little in return.

Share in other sites/networks: These icons link to social bookmarking sites where readers can share and discover new web pages.
  • Reddit
  • email

If you liked this post, consider subscribing to the RSS feed or join us now at the IRC channels.

Pages that cross-reference this one

4 Comments

  1. williami said,

    January 16, 2010 at 2:24 pm

    Gravatar

    Speaking of MSNBOT, Open Watcom (a free and enhanced version of the Watcom C, C++, and FORTRAN compilers), was affected too by MSNBOT:

    http://cmeerw.org/blog/594.html

    Evil M$…

  2. Dennis Murczak said,

    January 16, 2010 at 3:12 pm

    Gravatar

    I was wondering about those contradictions (yesterday I read about Bing declining, today about gains). Thanks for shining some light on this.

    Roy Schestowitz Reply:

    Money on the table changes everything, as Larry Lessig explained with many examples:

    http://lessig.org/blog/2008/07/netroots_nation_keynote.html

    Someone mailed me about this a few hours ago, saying:

    Regarding the part of your article on the denial of service attack by the msnbot against some Perl-related sites, I find it entirely credible. I have a lot of images on my own Website and, several years ago, I noticed that the msnbot would often enough download all of the images with little or no pause. I felt that was exceptionally rude behaviour which no other search engine does. I put it down to Microsoft’s insensitivity and arrogance.

    At first, I tried excluding them via robots.txt but the frequent hits from msnbot still seemed to come. Apparently, others have had this problem:

    http://www.webmasterworld.com/forum93/411.htm
    http://www.webmasterworld.com/msn_microsoft_search/3065473.htm

    I then felt that my only recourse was to make a best effort to firewall Microsoft from accessing my site. I first tried to do the blocking narrowly but soon found out that their search engine bots run from many diverse IP ranges. I haven’t had this problem since I adopted a more broad-based block on Microsoft’s IP ranges. In a way, it’s regretable since perhaps some Microsoft employee might want to access my site for the same reason that anyone else would do but, in the end, it’s just karma.

    Roy Schestowitz Reply:

    Later he added:

    I might also add that I did consider that my decision to block Microsoft search bots from my site could negatively impact my site’s traffic. I decided to go ahead with it since Live/Bing/<whatever Microsoft wants to call it today> has such a small portion of the search market, that any impact would be minimal.

What Else is New


  1. Links 19/1/2021: Krita 4.4.2 Released and JingOS Hype

    Links for the day



  2. Team UPC Keeps Pretending That UPCA Can Still be Resurrected (Even Without the UK, Which is Strictly a Requirement)

    The latest distortion of facts regarding the Unified Patent Court (UPC) Agreement (UPCA) as seen from the lens of people who seek to profit from such distortion



  3. 'Ethical Source' is Not Ethical and Not a Movement But a Misguided Self-Serving PR Stunt

    Something which is neither enforceable nor ethical is being promoted by profoundly unethical media in the pockets of large corporations



  4. InteLeaks – Part XXI: Intel Seeking Advice From a Bunch of Clowns (Harbor 'Research')

    A firm called Harbor 'Research' is making dubious recommendations to Intel; as shown in the above video, there's also an obsession with buzzwords (typically suggestive of a lack of technical grasp/understanding)



  5. IRC Proceedings: Monday, January 18, 2021

    IRC logs for Monday, January 18, 2021



  6. The US Election Was Not Rigged, But the Nomination Process Was (Undermined to Maintain Control by Oligarchy)

    Cheating/driving the left out of the Democratic Party seems like a longstanding tradition and we know who stands to gain from it; moreover, problems remain in the voting process because it's controlled by secret code of companies like Microsoft (in spite of the openwashing)



  7. InteLeaks – Part XX: Redacted (for Names Only) Release of Intel File About Developer eXperience (DX) Meddling in GNU/Linux

    Today (or tonight) we release the first 'phase' of InteLeaks in a sensibly redacted form; coming up next is a surprise from Team Microsoft



  8. Sites in Bed With the EPO and UPC 'Covering' the 'News' Without Mentioning Any of the Overt Abuses

    It is rather sad that blogs like IP Kat have turned into proponents of abusive EPO management and Team UPC increasingly resorts to lying using pseudonyms (to avert criticism and accountability); much of the rebuttal or response that’s hinged on reality/facts can only be found in comments, which are still subjected to a face-saving moderation process (conducted by Team UPC)



  9. Suppressed Facts of the Free Software Movement and Its Community of Volunteers – Part IV: Stories From the Depths of the Free Software Foundation (FSF)

    To reduce or alleviate suspicions and a potential of mistrust the FSF needs to become more transparent and liberate information (such as the real reason Bradley Kuhn left, as noted in the previous part)



  10. Links 18/1/2021: GNU Radio 3.9, Wikipedia at 20

    Links for the day



  11. InteLeaks – Part XIX: Intel's Web 'Experts' Seen as Microsoft Champions Dealing With the Platform Microsoft is Looking to Destroy

    Things aren't rosy at Intel because the hires aren't suitable for the job of documenting and/or presenting GNU/Linux-centric products (whose target audience is Free software developers)



  12. Adding Images as Characters to the Daily Bulletins of Techrights

    Our daily bulletins now have inside them coarse graphics, depicted using characters alone, and the tool used to generate them announced a new release earlier today; we showcase some of its features (in a new video)



  13. Links 18/1/2021: Weekly Summaries and Linux 5.11 RC4

    Links for the day



  14. IRC Proceedings: Sunday, January 17, 2021

    IRC logs for Sunday, January 17, 2021



  15. The Oligarchs' Parties Will Never Choose the Side of Software Freedom Because Free Software Cannot Bribe Officials

    The tough reality is that next week's (or this coming week's, depending on what Sunday counts as) inauguration ceremony is partly symbolic as all the same and important issues remain largely untouched, for corporations control almost everything of significance



  16. COVID-19 Has Actually Helped Software Freedom Due to Financial and 'Spare Time' Factors

    Developers and users are increasingly exploring what the Free software world has to offer; this is actually measurable and it contradicts claims to the contrary



  17. Future Plans and Using Videos to Complement Text

    Remarks on recent and impending site changes; We are not replacing text with video, we're just trying to enhance the presentation a bit, especially where visuals help make a point or where browsing through Web sites (or leaks) is more suitable than static, linear presentation



  18. InteLeaks – Part XVIII: Intel Does Not Know How to Properly Do Research and It Seems Apparent Unscientific Methods Are Used to Justify Poor Documentation

    There appears to be a severe crisis at Intel; they cannot recruit scientists (or those whom they recruited are walking away) and as a result the company produces bad products with poor documentation (or highly defective chipsets that top-notch marketing cannot compensate for); in this video we walk through some examples of how studies are being conducted (as already noted in Part XVII)



  19. Suppressed Facts of the Free Software Movement and Its Community of Volunteers – Part III: The Free Software Foundation (FSF) Seems More Like a Victim of Destabilisation Campaigns

    The Free Software Foundation (FSF), which turns 36 later this year, is looking to raise money that helps support the GNU Project, soon 38 years old and likely the most important Free software project to exist (ever)



  20. Links 17/1/2021: EasyOS on Raspberry Pi and GNU libsigsegv 2.13

    Links for the day



  21. InteLeaks – Part XVII: The High Cost of Microsoft Windows Users in GNU/Linux Development Teams

    A look inside Intel explains what holds back the technical team, which bemoans the lesser technical people getting in the way and not even using the product that they are writing about



  22. IRC Proceedings: Saturday, January 16, 2021

    IRC logs for Saturday, January 16, 2021



  23. Suppressed Facts of the Free Software Movement and Its Community of Volunteers – Part II: Why Bradley Kuhn Left the Free Software Foundation (FSF)

    The founder of the FSF is still at the FSF (albeit not publicly) and the person who lobbied to oust him has basically been 'banished' by the founder



  24. Links 16/1/2021: LibreOffice 7.1 Release Candidate, Zeroshell 3.9.5, FreeBSD Report, and GhostBSD 21.01.15

    Links for the day



  25. Free Speech on the Web Not Respected by Companies That Used to Support Software Freedom

    Mozilla does not have to make its Web browser about politics; it can just make an excellent piece of software that is neutral about the Web pages that it renders, based on the user's personal preferences



  26. Suppressed Facts of the Free Software Movement and Its Community of Volunteers – Part I: We Are Under Attack by Corporations and Their Salaried Facilitators

    The corporate takeover (taking over the Commons, produced by volunteers who are motivated by altruism) is a subject we must speak about and somehow tackle; this series will highlight uncomfortable or difficult truths



  27. InteLeaks – Part XVI: Intel Cannot Do Command Line, Even When It's Vastly Simpler and More Suitable for Development

    The Developer eXperience (DX) team at Intel seems to be full of Microsoft drones instead of developers and/or mildly technical people; this has not only harmed the quality of documentation but also upset staff, alienating people who actually understand what developers need (more than buzzwords like "DX")



  28. IRC Proceedings: Friday, January 15, 2021

    IRC logs for Friday, January 15, 2021



  29. Links 15/1/2021: KaOS 2021.01, Whisker Menu 2.5.2, Istio 1.8.2

    Links for the day



  30. InteLeaks – Part XV: Intel is Blind to Blind and Colour-Blind People

    Intel does not seem to grasp very basic concepts associated with accessibility; nevertheless, Intel shamelessly tries painting itself as "woke" and a "justice warrior" (policing speech while overlooking much-needed practical work)


RSS 64x64RSS Feed: subscribe to the RSS feed for regular updates

Home iconSite Wiki: You can improve this site by helping the extension of the site's content

Home iconSite Home: Background about the site and some key features in the front page

Chat iconIRC Channel: Come and chat with us in real time

Recent Posts