• OctopusNemeses@lemmy.world
    link
    fedilink
    English
    arrow-up
    5
    ·
    edit-2
    17 hours ago

    He’s too cheap to pay for better data annotators. I heard a few weeks ago that I’m getting a fraction of what others are paid at other firms for the same work.

    • Buddahriffic@lemmy.world
      link
      fedilink
      English
      arrow-up
      5
      ·
      9 hours ago

      Hate to break it to you but quality of data isn’t the fundamental problem with LLMs. It’s that they are trying to use statistics to encode entire thought processes into hidden variables from conversation snippets. They want to use statistics to go from many individual interactions to a large model, and then use that model to predict individual interactions again. Which you can do with statistics, but it’s predicting the average text that follows the prompt, not the correct text (it has no concept of correctness; whenever it “talks” about it, that’s just the average text that follows, not any particular insight into what’s correct or even how it works).

      That’s not to say that the quality of the training data has no impact; it can have a huge impact. I’m just saying that even if the training data was perfect, the LLM will still get things wrong in its output.

      • heh@lemmy.world
        cake
        link
        fedilink
        English
        arrow-up
        2
        ·
        edit-2
        8 hours ago

        I listened to a podcast with a couple smart mathematicians talking about AI recently and this rings true based off what I heard them discuss.

        They hypothesized that only verifiable domains can really see advances due to AI. So mathematics, physics, a load of the other sciences, and medical research. Even programming, as long as you have a pre-designed solution.

        But for problems where you can’t look at a solution and say “yeah, that’s an optimal solution or close to it”, ie basically any business problem; they are much less useful, a big reason being what you mentioned in your comment.

  • brucethemoose@lemmy.world
    link
    fedilink
    English
    arrow-up
    11
    ·
    edit-2
    1 day ago

    Well, that’s because Zuckerberg felt FOMO and fired the Llama team over one bad experiment he probably pressured them into in the first place (as Llama 4 seemed like a “quick and dirty” attempt to copy Deepseek to me).

    He hired literal narcissists in their place, who gave him big promises they couldn’t possibly keep, given their background.


    Meta was literally at the center of open weights/open source ML land, which is where all this will eventually settle. Between that and PyTorch, they could have been at the center of the universe.

    But they aren’t, because Zuck is so unbelievably insecure.

    I’m not one to blame individuals for anything; systemic failure is complex. But he actually did this to himself.


    And what’s bizarre is, somehow, it will work out for him.

    I’ve been criticizing Facebook since I was in high school and it was all the rage. But here we are. Zuckerberg is more “revered” than ever.

  • cannedtuna@lemmy.world
    link
    fedilink
    English
    arrow-up
    10
    ·
    2 days ago

    Why does every photo of him look like he’s a beta release robot being shown off at a tech expo?