EditorsAbout the SiteComes vs. MicrosoftUsing This Web SiteSite ArchivesCredibility IndexOOXMLOpenDocumentPatentsNovellNews DigestSite NewsRSS

05.19.09

DDOS and Migration (Updated)

Posted in Boycott Novell, Site News at 7:33 pm by Dr. Roy Schestowitz

Summary: Boycott Novell had been under DDOS attacks for almost 4 days. We were struggling to just stay online while hosts investigated where the attacks came from. We moved between hosts (to semi-dedicated) and the same pattern of attack persisted until yesterday.

WE have kept silent about it in order not to encourage the attacker/s, but it’s true. We have been under heavy DDOS attacks since Thursday night. What has happened since then? Well, a lot. Our previous host is no more as far as we are concerned. After struggling with the botnet for like 10 hours (filtering to no avail) our Web site got isolated. It did not serve any pages for almost 2 days. A reader of Boycott Novell was kind enough to lend us room on his server (more or less dedicated), on which he fought the botnets for over a day. The attackers kept changing tactics. Some other readers offered filtering advice and we are grateful to all of them. Ultimately, the attacks halted yesterday afternoon.

“Ultimately, the attacks halted yesterday afternoon.”The migration from the old server was not simple because the site was disabled abruptly following the early attacks. But now we have ensured that all data has been migrated. The only ‘good’ thing which came out of this attack is that, as oiaohm put it, the ordeal sort of made us more robust to future attacks.

Now that we have a new host in place, we also have more features. Data on the site (comments, posts, etc.) was not lost in the migration, just heaps of time and effort affecting several people. We have moved to a bigger, more robust environment that will hopefully facilitate the needs of the Web site as it continues to grow (we served about 200GB of data last month). We apologise for the downtime, which is unprecedented.

The plan is to carry on exposing Comes exhibits next month and also organise the Wiki. There is enough for years of work.

Again: we would like to thank all those who helped during the downtime and especially our generous reader ( Copilotco) who offered to host the Web site, taking us away from shared hosting in the process. Dedicated servers on normal Web hosts are just far too expensive for us to afford and I swear that I never made a single dime from this Web site. The ads merely covered the hosting fees which Shane has been paying since 2006.

One last clarification for lunatics who are now suggesting that we DDOSed ourselves, where to even begin refuting such nonsense (coupled with personal abuse)?

The attacks came from many addresses, for example 88.198.60.8 which is “tor-proxy.va6.de”. Multiple such IPs hit us constantly and relentlessly (all tor exit nodes at first). At one stage it seemed like the front page alone received 3 page requests per second. But the IPs were also doing a HEAD on the Web site as many times as possible, bringing the server down to its knees (both the old server and new server, the former running Red Hat and the latter CentOS).

Update: Here is a report from the administrator.

I took over hosting of boycottnovell.com for Roy in the middle of the DDOS attack. I am looking at the squid log for boycottnovell.com during the DDOS. I have squid caching/proxying/url-rewriting for apache for various reasons.

The attack initially (or at least, at the time the DNS was re-pointed to my server) consisted of lots of HEAD requests. Then I wrote up a script to tail the log finding anyone doing lots of HEAD requests and putting the offending IP into the iptables packet filter while I cooked up a more permanent solution. Eventually they figured this out and switched to a full on GET of the root of the site and then I think they started getting random pages from the site as fast as they could although I’m not sure about that.

The interesting part starts around timestamp 1242543590.804 which is apparently when most of the world’s DNS cut over to me including that of the machines in whatever bot net was employed in the attack.

If we run this command on the logfile with the logfile being /tmp/bn.log:


grep " HEAD http://boycottnovell.com/ " /tmp/bn.log | awk
'{print $3}' | sort | uniq -c |sort -n | tail -10

we get:

   2716 81.175.61.4
   2960 212.24.147.228
   3056 204.209.56.56
   5637 87.236.199.73
   6645 145.100.100.190
   7261 212.42.236.140
   8487 88.198.14.120
   9640 62.141.58.13
  11008 87.118.104.203
  11269 88.198.60.8

and if we do:


grep " GET http://boycottnovell.com/ " /tmp/bn.log |
awk '{print $3}' | sort | uniq -c |sort -n|tail -10

we get:


   5801 94.136.16.242
   5854 85.25.152.185
   5865 212.24.147.228
   6367 66.35.1.170
   6682 205.209.142.210
   6977 87.118.104.203
   8102 83.140.125.188
   8300 85.25.145.98
   8441 212.42.236.140
  20065 66.230.230.230

So one IP did a get of the root of the site 20k times before I really effectively got everything blocked off and another did a HEAD around 11k times. You can get a feel for how the attack progressed using:


egrep ' GET http://boycottnovell.com/ | HEAD
http://boycottnovell.com/ ' /tmp/bn.log | less

Assuming that everyone who did a GET or a HEAD more than 100 times (a conservative estimate) is involved in the attack:


egrep ' GET http://boycottnovell.com/ | HEAD http://boycottnovell.com/ '
/tmp/bn.log | awk '{print $3}' | sort | uniq -c| sort -n > /tmp/attackers

and then counting only the lines with greater than 100 hits we can see that there were 281 unique IP addresses involved in the attack.

However, it looks like they switched to targeting various different parts of the site later on or maybe just random pages because if we look at all of the accesses to the site which made more than 100 requests we get 863 IPs involved the top 19 being the following:


   6193 62.141.53.224
   7153 85.25.151.22
   7764 145.100.100.190
   8524 66.35.1.170
   8757 94.136.16.242
   9256 85.25.152.185
  10369 83.140.125.188
  10464 212.24.147.228
  10874 205.209.142.210
  10935 87.236.199.73
  11441 88.198.14.120
  12094 62.141.58.13
  12208 88.198.60.8
  12994 66.249.70.134
  13940 85.25.145.98
  19119 212.42.236.140
  19867 87.118.104.203
  26480 216.105.40.113
  29854 66.230.230.230

So 66.230.230.230 made 29k requests to the site in total.

Putting some iptables rules in place (which I document here):

http://www.kernel-panic.org/pipermail/kplug-list/2009-May/108075.html

nicely cut the problem down to size and now the effect of the DOS is unnoticeable.

11M of gzipped log are used for this sample.

Share in other sites/networks: These icons link to social bookmarking sites where readers can share and discover new web pages.
  • Reddit
  • email
  • Slashdot

If you liked this post, consider subscribing to the RSS feed or join us now at the IRC channels.

Pages that cross-reference this one

4 Comments

  1. Test said,

    May 20, 2009 at 7:09 am

    Gravatar

    site is super zippy fast now !

    great work team !

  2. aeshna23 said,

    May 20, 2009 at 8:48 pm

    Gravatar

    It’s sad that some people are so afraid of the ideas on this website that they resort to such tactics.

    I do have one suggestion, if this happens in the future. Don’t put long, technical explanations in the main post. You could put a link to a page with the long, technical explanation. The long, technical explanation dilutes the moral indignation about our opponents tactics. I know that what I’m saying is a rhetorical change, but rhetoric really matters here.

  3. Shane Coyle said,

    May 21, 2009 at 7:53 pm

    Gravatar

    Actually, according to Google, I am still receiving hits and clicks from BN for Adsense. I guess when you copied over the site you left in the publisher id for my account.

    Roy Schestowitz Reply:

    Shane,

    Yes, I am still speaking to Tracy to figure out how we shall work this out. I moved all three domains to his DNS namehost and we will probably use the adverts to pay him for all he has done to save us, not to mention hosting. Last night we moved to account to a VM (to limit the damage of future attacks).

What Else is New


  1. There Are Too Many Types of Cars...

    "Choice is malicious," say the antagonists



  2. Reversal of Narratives by Internet Trolls (Spinning Reaction to Their Trolling as 'Abuse')

    Organisations that engage in demonisation of people (typically those who expose the abuses of such organisations) somehow evade the standards of Codes of Conduct, as if Codes of Conduct are covertly designed not to protect individuals but to empower those who already have all the powers (or front for powerful people/corporations)



  3. Ongoing (Albeit Secret) Campaign of Patent Extortion Against GNU/Linux Distributions Using Software Patents, Even Expired Ones in Europe

    GNU/Linux distros attacked by software patents, even in Europe where no such patents are supposed to exist (or have any legal bearing)



  4. Links 19/10/2020: Linux 5.9-ck1/MuQSS, Linux Kodachi 7.3

    Links for the day



  5. Java's James Gosling is Wrong. Free Software Advocates Never Suggested or Insinuated That Money-Making Was Ethically Wrong.

    The honorable James Gosling mischaracterises the stance of Free software advocacy, portraying it like it is an issue of money rather than respect for users



  6. Maybe This is What Codes of Conduct Were Made for? Or to Prevent? (Updated)

    When people bemoan the abuse they receive from a so-called 'anti-harassment' team (covering up corporate corruption in a project by ousting people) this is the kind of thing they receive from colleagues or former colleagues



  7. Media Contradicts Itself, Redefines Proprietary Software as 'Open'... for Microsoft

    Proprietary GitHub is being spun as Microsoft going "open" (nothing could be further from the truth) in another EEE-type move with diffusion and confusion



  8. A Critic's Free Software Dictionary by figosdev

    Sarcastic take on often-spoken words in the domain of technology



  9. IRC Proceedings: Sunday, October 18, 2020

    IRC logs for Sunday, October 18, 2020



  10. Links 19/10/2020: OpenBSD 6.8, RapidDisk 7.0.0, Tails 4.11 Reviewed

    Links for the day



  11. The Different Types of Spammy 'Articles' and 'Reviews' Which Have Killed 'Professional Journalism' (Nowadays Mostly SPAM)

    The media has become so rogue that a lot of it is merely an extension of the marketing/PR industry; unless this is corrected, online publishers will fail to earn or maintain any degree of trust



  12. When the Software -- and by Extension Hardware and Network -- Controls the User...

    A distraction-free workflow is more likely to be attained using Free software than without it; in a world with information overload and 'surveillance capitalism' people need to carefully rethink what they do (or have done to them) digitally



  13. What the Linux Foundation Teaches People About GNU/Linux in LinuxFoundationX (edX) LFS101x “Introduction to Linux” [sic]

    Some annotated screenshots of preliminary sections of LFS101x, a 'course' designed to indoctrinate people for the Linux Foundation and the project is borrows its name from (but whose trademark it does not control)



  14. Shut Up and Learn to Maintain an Application Suite

    "Try and maintain a complex piece of software like a browser or an office suite, and then you'll understand."



  15. LinuxFoundationX (edX) LFS101x “Introduction to Linux” is More Linux Foundation Marketing and 'Linux' Revisionism Than Actual Training/Teaching

    The Linux Foundation makes a course about "Linux" partly about itself (the Linux Foundation, with top members like Microsoft and Oracle) and distorts the record with terms like "Open Source" and the pretense everything is "Linux" (even work that predates Linux itself)



  16. Microsoft Sheds Off Lots of Staff in This Autumn of COVID

    Microsoft is laying off more staff than we've estimated (even Azure staff) and the modus operandi disguises layoffs as mere departures (to make it seem wilful)



  17. [Meme] Microsoft's Calculator is Spyware

    The last thing GNU/Linux users need or want is yet another simple calculation tool, this one with Microsoft in control



  18. History's Lesson: Microsoft Now Does to GNU/Linux What It Did to Java (Creating 'Schism' to 'Wrest Control')

    We take a closer look at what Bill Gates admitted (under pressure, with 'smoking guns' to compel him into admission) regarding his rogue tactics



  19. When You Have to Use Windows for Something (Like Work) But You Really Don't Want Anything Proprietary or Microsoft-Controlled

    The situations/scenarios where GNU/Linux and BSD geeks need to 'touch' Windows for something (usually remotely) rapidly dwindle; those who are still using Windows on a laptop/desktop in 2020 are considered tech-illiterate or regarded as 'dinosaurs' (hence the dishonour meme above)



  20. Links 18/10/2020: Kodachi 7.3 and OpenBLAS 0.3.11

    Links for the day



  21. Surveillance in (and/or by) Free Software is a Growing Problem

    If Free software ceases to respect personal privacy (full control over one’s computing), does it still protect users’ freedom? That’s a question or an aspect not dealt with by the Four Freedoms — and one that’s worth entertaining as so-called ‘surveillance capitalism’ grows (data as currency, people as ‘products’ to be sold)



  22. Bill Gates Refers to His Business as “Jihad” and Accuses Java of Being a “Religion” With “Rabid” Supporters

    Peace disallowed by Bill Gates, as usual; to him, this is all just a religious war that strives to cull out and eliminate or convert the 'infidels' (those who reject his religion); the Bill Gates deposition tapes show his deep concerns and fear of Java APIs



  23. IRC Proceedings: Saturday, October 17, 2020

    IRC logs for Saturday, October 17, 2020



  24. [Meme] Openwashed (and Spying) 'Killer App' for GNU/Linux? A Basic Windows Calculator!

    There's no "Linux" news to cover more important and urgent than just another useless calculator (this one with notorious Microsoft telemetry) being ported to GNU/Linux



  25. Links 17/10/2020: No GNU/Linux for 10 Days, Google Coral Dev Board Runs Debian

    Links for the day



  26. Open-Sourcing the Investigation of Gates Deposition Tapes and Their Relationship to Current (Present) Affairs

    The so-called 'philanthropist' and 'giver' that the media tells us Bill Gates suddenly became (he has earned another ~$10,000,000,000 since the pandemic began) needs further exposing because, having raided the software world (monopoly by law-breaking), he now does the same in other domains



  27. The Supposedly 'Soft' Bill Gates Interrogated About What Was Called His “Jihad”

    We revisit the odd choice of words (repeatedly used by Mr. Gates internally), suggestive of some divine call for war/arms in the business context



  28. Why Microsoft Will Not Embrace GNU/Linux (to Replace Windows)

    The Bill Gates deposition shows that Gates was aware Windows had become a market monopoly and sought to leverage that to push whatever “killer app” he thought would shield Microsoft’s monopoly; those tactics never changed (here’s an example from two days ago: “Microsoft is foisting Office web apps on Edge users”)



  29. The Sad Story of Mozilla Keeps Getting Sadder Because Mozilla's Managers Abandoned Users and Chose Companies as Their Clients

    Mozilla's business model keeps changing for the worse, as the "app" mentality and/or the "social control media" mindset are chosen over the needs of actual (longtime) users, limiting the extensibility of the Firefox browser in the name of "performance" or "simplicity" (as if all that users need is "dark mode" and a choice of search engines)



  30. IRC Proceedings: Friday, October 16, 2020

    IRC logs for Friday, October 16, 2020


RSS 64x64RSS Feed: subscribe to the RSS feed for regular updates

Home iconSite Wiki: You can improve this site by helping the extension of the site's content

Home iconSite Home: Background about the site and some key features in the front page

Chat iconIRC Channel: Come and chat with us in real time

Recent Posts