HN

Need help?
<- Back
AWS North Virginia data center outage – recovery to take hours

AWS North Virginia data center outage – recovery to take hours

christhecaribou

Comments (124)

  • cmiles8
    AWS’s US-East 1 continues to be the Achilles heel of the Internet.And while yes building across multiple regions and AZs is a thing, AWS has had a string of issues where US-East 1 has broader impacts, which makes things far less redundant and resilient than AWS implies.
  • aurareturn
    These things are dangerous. Someone who can take AWS down such as an employee can place a bet.These bets aren’t as innocent as they seem because the bettors can often influence or change the outcome.
  • fabian2k
    I thought cooling was pretty much pre-planned in any data center, and you simply don't install more stuff than you can cool?So did some cooling equipment fail here or was there an external reason for the overheating? Or does Amazon overbook the cooling in their data centers?
  • corvad
    It's always East 1... Jokes aside I don't understand how often east-1 is taken down compared to other regions. Like it should be pretty similar to other regions architecture wise.
  • merek
    Related:AWS EC2 outage in use1-az4 (us-east-1)https://news.ycombinator.com/item?id=48057294
  • fastest963
    Coinbase claimed multiple AZs were down but the AWS statement was that only a single AZ was affected. Does anyone have more details?
  • Havoc
    Could someone explain to me why they don't build these things near oceans? Like nuclear plants that need plenty cooling capacity tooTwo loop cycle with heat exchanger to get rid of the heat
  • sitzkrieg
    using aws since s3 came out and i’ve yet to see any major company do multi az failover in any capacity whatsoever. default region ftw
  • anon
    undefined
  • yomismoaqui
    How many nines of are we at this year?
  • matt3210
    Right, cooling.
  • nikcub
    both realtime markets where multi-AZ is hard?
  • jeffbee
    I don't see anything on downdetector suggesting this was particularly disruptive.
  • fukinstupid
    Y'all Are Fuckin Stupid!
  • aussieguy1234
    Once known for having super reliable services, I've heard this company is scrambling to re hire some of the engineers they overconfidently "replaced" with AI.When customers pay for cloud services, they expect them to be maintained by competent engineers.edit: Not sure why the downvotes. If you fire the engineers that have been keeping your systems running reliably for years, what do you expect to happen?
  • tcp_handshaker
    I bet post-mortem will say vibe coding confused fahrenheit and celsius, we run too hot...
  • OhMeadhbh
    [flagged]
  • BugsJustFindMe
    [flagged]
  • tailscaler2026
    us-east-1 is down? shocking! stop putting SPOF services there. this location has had frequent issues for the past 15 years.