• Warl0k3@lemmy.world
    link
    fedilink
    English
    arrow-up
    16
    ·
    edit-2
    3 days ago

    How often do you check the summaries? Real question, I’ve used similar tools and the accuracy to what it’s citing has been hilariously bad. Be cool if there was a tool out there that was bucking the trend.

    • MaggiWuerze@feddit.org
      link
      fedilink
      English
      arrow-up
      6
      ·
      2 days ago

      Yeah, we were checking if school in our district was canceled due to icy conditions. Googles model claimed that a county wide school cancellation was in effect and cited a source. I opened, was led to our official county page and the very first sentence was a firm no.

      It managed to summarize a simple and short text into its exact opposite

    • truthfultemporarily@feddit.org
      link
      fedilink
      English
      arrow-up
      2
      ·
      edit-2
      2 days ago

      Depends on how important it is. Looking for a hint for a puzzle game: never. Trying to find out actually important info: always.

      They make it easy though because after every statement it has these numbered annotations and you can just mouse over to read the text.

      You can chose different models and they differ in quality. The default one can be a bit hit and miss.