'Completely unprecedented' outage causes havoc with IT systems across globe — as it happened
www.abc.net.au
A massive IT systems outage caused by issues with CrowdStrike software affects banks, airports, supermarkets and media companies across Australia and around the world.
  • DeltaTangoLima@reddrefuge.comEnglish
    0·
    4 months ago

    This has been a fun end to the week - still sitting on a call about the widespread outages and impacts from this.

    At which point do we acknowledge the cure is as bad as the problem?

    • Roopappy@lemmy.mlEnglish
      0·
      4 months ago

      At which point do we acknowledge the cure is as bad as the problem?

      Didn’t we all do that when we stopped using Norton Anti-virus?

  • Scrubbles@poptalk.scrubbles.techEnglish
    0·
    4 months ago

    As a developer, man do people not realize how brittle modern computing is. It’s all built in popsicle sticks and Elmer’s glue. One small config or bad file as we see can cripple entire industries.

    I do love that windows is still like “something slightly wrong? Might as well crash”

  • DigitalDilemma@lemmy.mlEnglish
    0·
    4 months ago

    It seems to be crowdstrike reacting to the new update.

    We have got ours up by the very manual process of:

    1 Boot into safe mode.

    1. Navigate to C:\windows\system32\drivers\crowdstrike

    2. Delete C-00000291*.sys

    3. Reboot normally

    • Potatisen@lemmy.world
      0·
      4 months ago

      Maybe a stupid question but why would not reaching an online service (?) blue screen your computer?

      • Destide@feddit.ukEnglish
        0·
        4 months ago

        Missing data in the boot sequence if that data is stored as a cloud init or a key is needed for auth during boot. So if you’re running thin clients and rely on something like Ansible, but now the thin client can’t get to the service it can’t boot, so critical error.

      • Ooops@feddit.org
        0·
        4 months ago

        It’s the other way around. All those PCs are bluescreening at boot. So that prevents fixing the system remotely and on a large scale. Now poor IT guys have to fix evey single one by hand.

      • lmaydev@lemmy.world
        0·
        4 months ago

        I guess if the code acted as if it got a valid response without checking it could get into a very weird state. Or the code just fails hard.

        At the driver level it’s very easy to kill things.

  • qprimed@lemmy.mlEnglish
    0·
    4 months ago

    so it got backdoored, or QA is trash or both at the same time. hate it when CI builds come so fast you cant verify the latest shipping rootkit