A shocking story was promoted on the “front page” or main feed of Elon Musk’s X on Thursday:

“Iran Strikes Tel Aviv with Heavy Missiles,” read the headline.

This would certainly be a worrying world news development. Earlier that week, Israel had conducted an airstrike on Iran’s embassy in Syria, killing two generals as well as other officers. Retaliation from Iran seemed like a plausible occurrence.

But, there was one major problem: Iran did not attack Israel. The headline was fake.

Even more concerning, the fake headline was apparently generated by X’s own official AI chatbot, Grok, and then promoted by X’s trending news product, Explore, on the very first day of an updated version of the feature.

    • Ottomateeverything@lemmy.world
      link
      fedilink
      English
      arrow-up
      60
      arrow-down
      1
      ·
      2 years ago

      I bet if such a law existed in less than a month all those AI developers would very quickly abandon the “oh no you see it’s impossible to completely avoid hallucinations for you see the math is just too complex tee hee” and would actually fix this.

      Nah, this problem is actually too hard to solve with LLMs. They don’t have any structure or understanding of what they’re saying so there’s no way to write better guardrails… Unless you build some other system that tries to make sense of what the LLM says, but that approaches the difficulty of just building an intelligent agent in the first place.

      So no, if this law came into effect, people would just stop using AI. It’s too cavalier. And imo, they probably should stop for cases like this unless it has direct human oversight of everything coming out of it. Which also, probably just wouldn’t happen.

    • rayyy@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      ·
      2 years ago

      Another of Musk cutting corners to the max and endangering lives but why should he care? He is in control and that is the only thing that matters to him, even if he loses billions of dollars.

  • sik0fewl@lemmy.ca
    link
    fedilink
    English
    arrow-up
    60
    ·
    2 years ago

    To everyone that goes to “X” to get the “real”, unfiltered news, I hope you can see that it’s not that site anymore.

    • Fedizen@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      2 years ago

      it was the “yell at celebrities” website. The whole “buy a blue check” thing destroyed it.

    • expr@programming.dev
      link
      fedilink
      English
      arrow-up
      31
      arrow-down
      1
      ·
      2 years ago

      In case you’re not familiar, https://en.m.wikipedia.org/wiki/Grok.

      It’s somewhat common slang in hacker culture, which of course Elon is shitting all over as usual. It’s especially ironic since the meaning of the word roughly means “deep or profound understanding”, which their AI has anything but.

  • Nobody@lemmy.world
    link
    fedilink
    English
    arrow-up
    18
    ·
    2 years ago

    Beware, terminally incompetent interns everywhere. Doing something incredibly damaging to your company over social media on your first day is officially a job that’s been taken by AI.

  • Otter@lemmy.ca
    link
    fedilink
    English
    arrow-up
    9
    ·
    2 years ago

    I don’t really understand this headline

    The bot made it? So why was it promoted as trending?

  • IninewCrow@lemmy.ca
    link
    fedilink
    English
    arrow-up
    8
    arrow-down
    1
    ·
    edit-2
    2 years ago

    Same similiar thing happened with major newspapers about 100 / 150 years ago … governments realized that if any one group or company had control over all the information without regulation, businesses will quickly figure out ways to monetize information for the benefit of those with all the money and power. They then had to figure out how to start regulating newspapers and news media in order to maintain some sort of control and sanity to the entire system.

    But like the newspapers of old … no one will do anything about all this until it causes a major crisis or causes a terrible event … or events.

    In the meantime … big corporations controlling 99% of all media and news information will stay unregulated or regulated as little as possible until terrible things happen and society breaks down.

    • cygon@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      ·
      2 years ago

      I assume that Twitter still has tons of managers and team leads that allowed this and have their own part of the responsibility. However, Musk is known to be a choleric with a mercurial temper, someone who makes grand public announcements and then pushes his companies to release stuff that isn’t nearly ready for production. Often it’s “do or get fired”.

      So… an unshackled AI generating official posts, no human hired to curate the front page, headlines controlled through up-voting by trolls and foreign influence campaigns, all running unchecked in the name of “free speech” – that’s very much on brand for a Musk-run business, I’d say.

    • Fedizen@lemmy.world
      link
      fedilink
      English
      arrow-up
      6
      arrow-down
      1
      ·
      2 years ago

      “Somebody I don’t like said something bad about one of the worlds richest oligarchs therefore all criticism of him is invalid”

      The guy has enough money to protect himself from bad criticism and address narratives he doesn’t like; he doesn’t need sad pathetic losers defending him on the internet like he’s a defenseless baby.

      • Ginger666@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        arrow-down
        4
        ·
        2 years ago

        You people will take a statement, then do mental gymnastics in your mind to make it fit your retarded narrative.

        Holy fuck

        • Cris@lemmy.world
          link
          fedilink
          English
          arrow-up
          3
          ·
          edit-2
          2 years ago

          I mean, he’s responsible for a pretty heinous thing in this instance… It’s not like people are pissing their pants over nothing.

          If your company publishes an explicitly fabricated headline stating there was a missile attack that never happened, generated by ai, and then presented to a ton of people on a major social media site, criticism is pretty deserved… (≖_≖ )