• huginn@feddit.it
    link
    fedilink
    English
    arrow-up
    39
    arrow-down
    1
    ·
    2 years ago

    This is exactly what I’m talking about when I argue with people who insist that an LLM is super complex and totally is a thinking machine just like us.

    It’s nowhere near the complexity of the human brain. We are several orders of magnitude more complex than the largest LLMs, and our complexity changes with each pulse of thought.

    The brain is amazing. This is such a cool image.

    • Khanzarate@lemmy.world
      link
      fedilink
      English
      arrow-up
      9
      arrow-down
      3
      ·
      2 years ago

      I think of LLMs like digital bugs, doing their thing, basically programmed.

      They’re just programmed with virtual life experience instead of a traditional programmer.

    • AEsheron@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      arrow-down
      3
      ·
      2 years ago

      I agree, but it isn’t so clear cut. Where is the cutoff on complexity required? As it stands, both our brains and most complex AI are pretty much black boxes. It’s impossible to say this system we know vanishingly little about is/isn’t dundamentally the same as this system we know vanishingly little about, just on a differentscale. The first AGI will likely still have most people saying the same things about it, “it isn’t complex enough to approach a human brain.” But it doesn’t need to equal a brain to still be intelligent.

      • huginn@feddit.it
        link
        fedilink
        English
        arrow-up
        2
        ·
        edit-2
        2 years ago

        but it isn’t so clear cut

        It’s demonstrably several orders of magnitude less complex. That’s mathematically clear cut.

        Where is the cutoff on complexity required?

        Philosophical question without an answer - We do know that it’s nowhere near the complexity of the brain.

        both our brains and most complex AI are pretty much black boxes.

        There are many things we cannot directly interrogate which we can still describe.

        It’s impossible to say this system we know vanishingly little about is/isn’t dundamentally the same as this system we know vanishingly little about, just on a differentscale

        It’s entirely possible to say that because we know the fundamental structures of each, even if we don’t map the entirety of eithers complexity. We know they’re fundamentally different - Their basic behaviors are fundamentally different. That’s what fundamentals are.

        The first AGI will likely still have most people saying the same things about it, “it isn’t complex enough to approach a human brain.”

        Speculation but entirely possible. We’re nowhere near that though. There’s nothing even approaching intelligence in LLMs. We’ve never seen emergent behavior or evidence of an id or ego. There’s no ongoing thought processes, no rationality - because that’s not what an LLM is. An LLM is a static model of raw text inputs and the statistical association thereof. Any “knowledge” encoded in an LLM exists entirely in the encoding - It cannot and will not ever generate anything that wasn’t programmed into it.

        It’s possible that an LLM might represent a single, tiny, module of AGI in the future. But that module will be no more the AGI itself than you are your cerebellum.

        But it doesn’t need to equal a brain to still be intelligent.

        First thing I think we agree on.