Screenshot of this question was making the rounds last week. But this article covers testing against all the well-known models out there.

Also includes outtakes on the ‘reasoning’ models.

  • TrackinDaKraken@lemmy.world
    link
    fedilink
    English
    arrow-up
    31
    arrow-down
    3
    ·
    1 month ago

    I think it’s worse when they get it right only some of the time. It’s not a matter of opinion, it should not change its “mind”.

    The fucking things are useless for that reason, they’re all just guessing, literally.

    • HugeNerd@lemmy.ca
      link
      fedilink
      English
      arrow-up
      4
      arrow-down
      15
      ·
      1 month ago

      they’re all just guessing, literally

      They’re literally not.

      • m0darn@lemmy.ca
        link
        fedilink
        English
        arrow-up
        15
        arrow-down
        1
        ·
        1 month ago

        Isn’t it a probabilistic extrapolation? Isn’t that what a guess is?

        • HugeNerd@lemmy.ca
          link
          fedilink
          English
          arrow-up
          1
          ·
          29 days ago

          In people, even animals. In a pile of disorganized bits and bytes in a piece of crap? No.

        • vii@lemmy.ml
          link
          fedilink
          English
          arrow-up
          2
          arrow-down
          5
          ·
          30 days ago

          This gets very murky very fast when you start to think how humans learn and process, we’re just meaty pattern matching machines.