08.09.20

It Looks Like Red Hat’s (IBM) Fedora Project May be ‘Outsourced’ to Amazon’s Datacentres

Posted in Red Hat at 3:11 am by Dr. Roy Schestowitz

Amazon datacentres in Ashburn
Amazon datacentres in Ashburn (source: Wikileaks)

Summary: In “seeking a more modern and cost effective location” for Fedora Infrastructure it seems to have been decided, privately, that Amazon (AWS) would be the new home of this project; but there’s sufficient obfuscation surrounding the matter and many people seem to be totally unaware

OVERNIGHT we’ve spent several hours researching this and we also asked some Fedora people, who don’t seem to know exactly what’s going on. Surely some people higher up the corporate chain have a better and clearer idea, but they’re not likely to speak about it because IBM pays their salary and there’s fear of further layoffs. A lot of the finer details will be available in IRC logs (frustratingly enough, almost all the coding/code hosting was outsourced to Microsoft), but the gist of it all is this: while examining about a dozen services of the Fedora Project we’ve occasionally stumbled upon Amazon addresses. And then there’s this:

dig copr.fedorainfracloud.org

; <<>> DiG 9.11.5-P4-5.1+deb10u1-Debian <<>> copr.fedorainfracloud.org
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 34423
;; flags: qr rd ra; QUERY: 1, ANSWER: 2, AUTHORITY: 0, ADDITIONAL: 1

;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags:; udp: 512
;; QUESTION SECTION:
;copr.fedorainfracloud.org.     IN      A

;; ANSWER SECTION:
copr.fedorainfracloud.org. 300  IN      CNAME   copr-fe.aws.fedoraproject.org.
copr-fe.aws.fedoraproject.org. 939 IN   A       3.81.0.123

This probably merits a little bit of context. A few hours ago Fedora Infrastructure had another very major OpenShift failure (not the first such incident over the past few days). Well, it wasn’t an issue until lately…

This so-called ‘cloud computing’ software is Red Hat’s brand (with GUIs and everything) of something that’s otherwise widely available as Free software but harder to use.

“Fedora Infrastructure Status: Major service disruption,” said the notice, reading out the extent of the impact: “New status major: issues with openshift cluster for services: Ipsilon, Badges, Blockerbugs, Package Updates Manager, Fedora Infrastructure Cloud, COPR Build System, Documentation website, Fedora elections, Account System, Fedora Messaging Bus, Fedora Calendar, Fedora pastebin service, The Koji Buildsystem, Koschei Continuous Integration, Kerberos, Mailing Lists, Module Build Service, Mirror List, Mirror Manager, Fedora Packages App, Pagure, Fedora People, Package maintainers git repositories, Fedora Container Registry, ABRT Server, Fedora websites, Fedora Wiki, Zodbot IRC bot”

“…while examining about a dozen services of the Fedora Project we’ve occasionally stumbled upon Amazon addresses.”And later on it said “New status good: Everything seems to be working.”

“We are now operating from the new datacentre and are bringing back capacity as time allows. The known issues are documented here in our wiki,” it adds. If one goes to the corresponding status page for pertinent services (“Fedora Project Datacentre Move”) it is linking to this wiki page, which in turn says: “This is a page to track known issues after the Fedora Infrastructure Datacenter move in 2020 from phx2 to iad2 and rdu2.”

Those are not descriptive names, as there’s not even a domain name/suffix. We tried tracing back the IP addresses of these services to identity where at least some these services were being moved to. “I think it’s more Red Hat management pressure to rely on Github and Google,” Ryan said, but it seems to be related to neither. “You know,” Ryan continued, “the infrastructure self-hosting was VERY reliable for many years before that.” He mentioned “GMail, Google Drive, calendar stuff” as examples, citing the anonymous post that said about Jim Whitehurst: “He didn’t use our products (used a Mac, along with other members of the executive management team), allowed RH to dump open source solutions for our own business to move things to Google’s services (which is a huge message to our very clients of “we don’t value or trust open source, so why should you?”)”

“A few hours ago Fedora Infrastructure had another very major OpenShift failure (not the first such incident over the past few days).”The migration pages are edited mostly by Kevin Fenzi (IBM/Red Hat), who wrote about it less than a year ago in the devel-announce mailing list. No replies to it as of this date.

Is Copr on AWS now? Seems so. If the new DC of Fedora is Amazon-owned and Amazon-controlled, there may be something to conclude. Depending on one’s opinion regarding Amazon and AWS, which turns Free/libre things into proprietary.

This message from last year says the hosting of various services is moving to the city/area in VA where AWS has many datacentres that already route some Fedora traffic. While we don’t know for sure what’s going on, as we need to better understand what plans are made in the boardroom (behind closed doors), it seems likely there’s a move to Amazon.

Four years ago The Atlantic published “Where Are Amazon’s Data Centers?” and it took note of Ashburn and Sterling. About a year later Wikileaks revealed that both places have lots of datacentres in them, mostly Ashburn (shown above is our screenshot of these).

Going back to Kevin, less than a year ago he wrote: “Fedora Infrastructure currently has the majority of its hardware in a datacenter in Arizona, USA. Red Hat leases this space for use by a number of teams, including Fedora.”

“This message from last year says the hosting of various services is moving to the city/area in VA where AWS has many datacentres that already route some Fedora traffic.”We can confirm, based on lots of checks, that many services still link to that datacentre.

“However,” Kevin continued, “they’ve been seeking a more modern and cost effective location for some time and have decided on one: So, we will be migrating to a new datacenter located in Ashburn, Virginia in 2020.”

Oh, Ashburn. Where Amazon has a densely-distributed cluster of datacentres.

Is Red Hat moving to ‘the cloud’ and, if so, why not its own? Does IBM feel like it needs to outsource that to a competitor/partner?

The details on this are still not certain and I could not get anybody from Fedora (in IRC) to confirm or deny. Quite frankly, many of them may not be aware.

Share in other sites/networks: These icons link to social bookmarking sites where readers can share and discover new web pages.
  • Reddit
  • email

This post is also available in Gemini over at:

gemini://gemini.techrights.org/2020/08/09/aws-fedoraproject/

If you liked this post, consider subscribing to the RSS feed or join us now at the IRC channels.

Pages that cross-reference this one

What Else is New


  1. Links 10/5/2021: Huawei's GNU/Linux Laptops and Kotlin 1.5.0

    Links for the day



  2. Richard Stallman on Writing rm, ls, and cp (Also Working on Bison)

    Dr. Richard Stallman, the Free Software Foundation's founder, explains what programs he developed in the eighties



  3. Raise the Roof

    Out comes the taxpayers’ subsidy, assured; with military the sky is the limit (and bailout guaranteed)



  4. Richard Stallman Replatformed 10 Hours From Now

    Link to the talk (when it goes live)



  5. [Meme] Bill Says, Bill Saves

    Bill Gates seems more likely to be indicted than to win a presidential election/term



  6. IRC Proceedings: Sunday, May 09, 2021

    IRC logs for Sunday, May 09, 2021



  7. According to the Wall Street Journal, Bill Gates’s Relationship with Jeffrey Epstein Caused the Bill-Melinda Divorce (While the Media Deflected to Dr. Stallman, Using a Phony 'Scandal')

    It’s becoming rather obvious that there’s real substance to accusations that Mr. Gates was in some sense enabling Jeffrey Epstein; while Gates-funded media told us that he was saving us from climate change and a pandemic (PR stunts for empathy and sympathy) Melinda worked really hard to distance herself from him, the father of her kids



  8. [Meme] Bill, What's Your Opinion?

    While it's ludicrous to insinuate that Mr. Gates somehow "started" COVID-19 he certainly "rode the wave" for reputation laundering purposes, profit, and distraction from scandals that precede the epidemic in China (and caused his marriage to break down)



  9. Links 10/5/2021: SystemRescueCD 8.03, KeePass 2.48 Released

    Links for the day



  10. How We Process and Upload Videos Hosted in Techrights

    With ffmpeg as the Swiss army knife (and various other utilities/programs ‘in between’) it’s possible to automate much of the pipeline associated with video production and self-hosting



  11. Richard Stallman's Free Software Speech in 2020 (FSF Turning 35)

    We've re-encoded (as WebM) the likely sole/only speech Richard Stallman gave about his movement last year; today seems like a suitable time to republish it because tomorrow a British university/group will replatform him (to use their term)



  12. The Chaos Theory

    Making GNU/Linux less stable and less predictable isn't good for GNU/Linux users; but it certainly helps sell Red Hat support contracts and vexation inside the community weakens Red Hat's competitors



  13. Gemini and Techrights: Still Growing in Gemini Space and Always Supporting/Loving the Protocol

    As we continue to expand in Gemini space (where our very large site became a very large and likely the largest capsule) it's worth explaining some of the overlooked merits of the protocol; unlike the World Wide Web (WWW) it does not impose things on the user/visitor, who is more or less in charge



  14. Links 9/5/2021: KDE Frameworks 5.82.0 Release and Patents Related to COVID Subjected to Waivers

    Links for the day



  15. Act More 'Professional' to Appease Mobs

    We should all think alike, dress alike, and like everybody (especially the business overlords)



  16. IRC Proceedings: Saturday, May 08, 2021

    IRC logs for Saturday, May 08, 2021



  17. Some Background on the Free Speech Society at the University of Buckingham, Where Richard Stallman is Being 'Replatformed'

    A private British university, the University of Buckingham, will 'host' (virtually) the most-defamed person in the Free software world; the Free Speech Society is only two years old and rationality for its existence is explained by its co-founder James Oliver



  18. Web Sites or News Sites Perish When Their Arguments Are Weak and/or Invalid

    "Just be honest!" is a simple motto for any site; but some sites sell out in pursuit of money or grandiosity, unlike us (we turned 14.5 years old on Friday)



  19. GNU/Linux Turns 38 (in 4 Months From Now)

    Contrary to what the Linux Foundation wants you to think, the operating system turns 38 later this year



  20. Richard Stallman: Steve Jobs Did Some Very Bad Things

    Dr. Richard Stallman told me about Steve Jobs that he had helped digitally imprison computer users



  21. GNU/Linux Founder Richard Stallman to Give a Talk at the University of Buckingham Tomorrow (Live Stream)

    Tomorrow it will be possible to watch this new talk live using Free software



  22. Then We Take Berlin...

    Homage to EPO, based in Munich and Berlin (and defended by the government in Berlin)



  23. The Right to Assemble, Fundamental Rights of Ownership, and Many Other Rights Are Under Attack

    Techrights will be dealing a lot more with erosion of what people have come to assume were “rights” (real rights, such as human rights, labour rights, not copy “rights” or patent “rights”); when rights are reduced to rubble the long-term consequences are severe, shows history



  24. TechBytes Episode 91: End of Privacy and End of Windows 10X

    Tim and Roy produce their 2nd audiocast since TechBytes returned



  25. The Cancel Song

    People who work for (or receive funding from) Nazi-associated IBM are still trying to turn the work/legacy of Richard Stallman (RMS) into dust/ashes



  26. Pro-Software Freedom Advocates and Free/Libre Software Supporters Face Barriers Due to Domination of Communication Channels (Beyond the Media)

    A carefully-checked assessment of an overlooked aspect surrounding the 'cancel mob', which incites and brainwashes people based on lies; there's an attempt to control channels of communication (e.g. Open and Free Technology Community and Freenode) and to generally suppress people who support the founder of GNU/Linux



  27. Bashing Free Software and GNU/Linux is a Terrible Business Model for Publishers

    Contrary to unflattering portrayals by hostile media that's sponsored by foes of Free software, the usage of Free software grows, even if things such as DRM and surveillance stand in the way of software freedom (which was wrongly assumed to be ushered in by Free software, irrespective of malicious features like 'telemetry')



  28. Links 8/5/2021: GIMP 2.99.6, Wine 6.8 Released

    Links for the day



  29. IRC Proceedings: Friday, May 07, 2021

    IRC logs for Friday, May 07, 2021



  30. [Meme] Outsourcing Audacity Development to Microsoft Proprietary Software and Then Copying Microsoft Tactics (and 'Telemetry')

    They've had the audacity to call it "telemetry" and pretend that surveillance companies (spying giants) cannot figure out who you are based on IP addresses


RSS 64x64RSS Feed: subscribe to the RSS feed for regular updates

Home iconSite Wiki: You can improve this site by helping the extension of the site's content

Home iconSite Home: Background about the site and some key features in the front page

Chat iconIRC Channel: Come and chat with us in real time

Recent Posts