Lies and Denial of Service Attacks from Microsoft Bing

Dr. Roy Schestowitz

2010-01-16 10:56:58 UTC
Modified: 2010-01-16 10:56:58 UTC

Summary: Microsoft-rewarded companies hail Bing while it's said to be down; crucial Perl services go down after MSNBOT goes out of control

EVERY firm that provides US-only statistics on search engines seems to be showing Microsoft's Bing on the decline (for December 2009). There is one exception. comScore, which is a Microsoft partner [1, 2, 3, 4, 5, 6, 7], contradicts the rest of the bunch, including Nielsen and Hitwise. This shows either that they are inaccurate or that there is a bias somewhere, favouring Microsoft at comScore (comScore is being paid by Microsoft and it cannot be trusted once its employees accept money from the very same company whose performance they assess in comparison to others').

The only thing they all agree on is that Google continues to gain.

Nielsen, Hitwise, and comScore are all in agreement, so onlookers can perhaps declare it official now: Google had a good December. comScore, the member of the trio that most recently released its search market data, didn't put Google up by a whole lot, though, and unlike the other firms, saw Bing gain ground.

The Bing-sponsored blog continues to show its bias and it says nothing about the fact that Microsoft is just buying some market share. Verizon is paid by Microsoft for example [1, 2]. So there are two issues here:

Microsoft paid comScore, which is now contradicting Nielsen and Hitwise when it claims Microsoft gains
Microsoft pays companies to remove Google as an option while blogs that it pays are claiming gains, describing that as success without mentioning those incentives (allegedly as much as $500,000,000 was paid to Verizon alone, in order to remove Google, despite customers' preference)

It is worth adding that the same Microsoft-rewarded blog shares some Xbox 360 sales figures (US-only, even though this is not mentioned in the headline); these show Nintendo completely smashing Microsoft. Why not show global figures? Why not explicitly mention and emphasise that the figures refer only to one country? It is Microsoft's home country where it battles against Japanese companies.

"MSNBOT must die!" says the Perl blog, which complains about Microsoft's bad bots overwhelming the server due to shoddy code. Even CPAN was affected.

If you've suffered any problems accessing any of the sites, the databases, the CPAN mirror, etc from the CPAN Testers server last night, please direct your wrath at Microsoft. Last night the msnbot took out the CPAN Testers server with a dedicated denial of service attack. As a consequence measures are now being put in place to completely ban the msnbot from accessing at least the Reports site, and probably all the sites on the server.

Microsoft in their incompetent wisdom decided to unleash 20-30 bots every few seconds. I know this because I can see the IP addresses in the logs. The ones spotted within a few minutes of rebooting the server this morning to clear the processes were

Microsoft can't even implement search right. An engine that's estimated to handle just 3% of the world's web search is causing far too much damage for far too little in return. ⬆

Comments

Dennis Murczak

2010-01-16 20:12:16

I was wondering about those contradictions (yesterday I read about Bing declining, today about gains). Thanks for shining some light on this.

Roy Schestowitz

2010-01-16 20:39:54

Money on the table changes everything, as Larry Lessig explained with many examples:

http://lessig.org/blog/2008/07/netroots_nation_keynote.html

Someone mailed me about this a few hours ago, saying:

Regarding the part of your article on the denial of service attack by the msnbot against some Perl-related sites, I find it entirely credible. I have a lot of images on my own Website and, several years ago, I noticed that the msnbot would often enough download all of the images with little or no pause. I felt that was exceptionally rude behaviour which no other search engine does. I put it down to Microsoft's insensitivity and arrogance.

At first, I tried excluding them via robots.txt but the frequent hits from msnbot still seemed to come. Apparently, others have had this problem:

http://www.webmasterworld.com/forum93/411.htm http://www.webmasterworld.com/msn_microsoft_search/3065473.htm

I then felt that my only recourse was to make a best effort to firewall Microsoft from accessing my site. I first tried to do the blocking narrowly but soon found out that their search engine bots run from many diverse IP ranges. I haven't had this problem since I adopted a more broad-based block on Microsoft's IP ranges. In a way, it's regretable since perhaps some Microsoft employee might want to access my site for the same reason that anyone else would do but, in the end, it's just karma.

Roy Schestowitz

2010-01-16 23:14:17

Later he added:

I might also add that I did consider that my decision to block Microsoft search bots from my site could negatively impact my site's traffic. I decided to go ahead with it since Live/Bing/<whatever Microsoft wants to call it today> has such a small portion of the search market, that any impact would be minimal.

williami

2010-01-16 19:24:59

Speaking of MSNBOT, Open Watcom (a free and enhanced version of the Watcom C, C++, and FORTRAN compilers), was affected too by MSNBOT:

http://cmeerw.org/blog/594.html

Evil M$...

IBM Stock Collapses and It's Only the Beginning: Will GAFAM soon follow and will any executives be arrested for the accounting fraud insiders have long cautioned about?
Over at Tux Machines...: GNU/Linux news for the past day
IRC Proceedings: Tuesday, July 14, 2026: IRC logs for Tuesday, July 14, 2026
Heshan de Silva-Weeramuni Becomes Program Manager at the Free Software Foundation (FSF): Heshan's addition means that the FSF is growing after a solid financial year (best in years)
Michael McMahon Explains Distributed Denial of Service (DDoS) Attacks on the Free Software Foundation (FSF): The real solution is a curb on botnets. A mitigation strategy, however, would involve going static.
Matters of Public Safety: "Police say Ann Widdecombe killed in 'targeted attack' as motive investigated"
The Register MS and Its Promotional Microsoft Content: It's not too hard to see what the business model of The Register MS is
IBM: From $306 to $212 in 7 Days, IBM Won't Go Up More Than 50% to Where It Was at 'Peak Vapourware': There's a limit to how much or how long a company can fake its performance and its potential [...] Early this morning a few insiders ("traders") cashed in on their "pump-n-dump"
Red Hat Staff Needs to Start Looking for the Next Job: Workers can conveniently lie or deny it to themselves, but waves of PIPs ("silent layoffs") will sweep over more and more units or teams as the company runs out of money to play with
IBM the Next Bear Stearns: IBM cannot recover if all it has to show is vapourware
I'll Be Extremely Difficult for Microsoft to Sell Any XBox Consoles Now: Microsoft understands this
How Software Freedom Would Benefit Everybody: A society that denies control by greedy companies would do a disservice to monopolies and improve all services to citizens
Links 14/07/2026: Harsh But Also Fair Criticism of Hey Hi (AI) Slop, 'Open' AI Shuts Down Its Own Products as Funds Run Out: Links for the day
Gemini Links 14/07/2026: Old CD Binder and AWK: Links for the day
In Defence of Physical Tickets: Tickets are not some "app" and not some "code" on some "screen"
Microsoft Layoffs Not Limited to XBox (False Narrative in the Mainstream Media): Microsoft is becoming less relevant and workforce reductions won't end any time soon
Links 14/07/2026: Plagiarism Spun as "Training", Zelensky Announces Leadership Shuffle: Links for the day
The Register MS Has Just Published "AI" Webspam That Mentions "AI" 54 Times. It Was Paid to Do This.: Who pays for all this "AI" hype or "buzz"?
Gemini Links 14/07/2026: Self-Advocacy Online; "The Internet Is Dead: How the Web Lost Its Human Soul": Links for the day
Over at Tux Machines...: GNU/Linux news for the past day
IRC Proceedings: Monday, July 13, 2026: IRC logs for Monday, July 13, 2026
Modern Technology Harms Women More Than Men (Because the 'Tech Bros' Who Dominate STEM Have a Poor View of Women): “Privacy protects us from abuses by those in power, even if we're doing nothing wrong at the time of surveillance.”
Internet Relay Chat Trolls Are Not Expressing Opinions, They Are Saboteurs: For the record
Links 14/07/2026: "The Freedom of Information Act Is in Serious Trouble"; Irish Datacenters Use Up Almost 25% of Total Energy: Links for the day
The Register MS: "AI" Puff Pieces for Sale, Not Journalism at All, Just "Webspam": The Register MS isn't the sole culprit
Over at Tux Machines...: GNU/Linux news for the past day
IRC Proceedings: Sunday, July 12, 2026: IRC logs for Sunday, July 12, 2026
How We Do Techrights (and What's Changing Next Week): Many former news sites no longer yield much non-meaningless news (not anymore); there's a gap to be filled

Lies and Denial of Service Attacks from Microsoft Bing

Comments

Recent Techrights' Posts