• DougPiranha42@lemmy.world
    link
    fedilink
    English
    arrow-up
    27
    arrow-down
    13
    ·
    21 hours ago

    Interesting. A client side bug causes server-level overload but only after unrelated changes gradually make the problem worse. Rerouting traffic to healthy servers overloads those too and spreads the outage. The client code surely “worked on my computer” lol

    • gian
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 hour ago

      Probably.

      Joking aside, the problem with testing is that you normally cannot have a complete copy of the production env to test against, with all the possible cases.
      You may have a test env that do not trigger certain corner case scenario which can be dependent on something completely out of the domain, like in this case.

      If they learned something, they would add some way of testing even this kind of scenario in the future.