lemmy.grys.it
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
just_another_person@lemmy.world to Linux@lemmy.worldEnglish · 6 months ago

AMD Announces "Instella" Fully Open-Source 3B Language Models

www.phoronix.com

external-link
message-square
11
link
fedilink
  • cross-posted to:
  • linux@lemmy.ml
49
external-link

AMD Announces "Instella" Fully Open-Source 3B Language Models

www.phoronix.com

just_another_person@lemmy.world to Linux@lemmy.worldEnglish · 6 months ago
message-square
11
link
fedilink
  • cross-posted to:
  • linux@lemmy.ml
alert-triangle
You must log in or # to comment.
  • TheGrandNagus@lemmy.world
    link
    fedilink
    English
    arrow-up
    16
    ·
    6 months ago

    Fully open and accessible: Fully open-source release of model weights, training hyperparameters, datasets, and code, fostering innovation and collaboration within the AI community.

    That’s actually pretty good. Seems to be open source as the OSI defines it, rather than the much more common “this model is open source, but the dataset is a secret”.

  • brokenlcd@feddit.it
    link
    fedilink
    English
    arrow-up
    1
    ·
    6 months ago

    The problem is… How do we run it if rocm is still a mess for most of their gpus? Cpu time?

    • just_another_person@lemmy.worldOP
      link
      fedilink
      English
      arrow-up
      1
      ·
      6 months ago

      Well it’s not necessarily geared towards consumer devices. As mentioned in the writeup, it’s not trained on consumer gear.

  • GaMEChld@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    edit-2
    6 months ago

    Smart people, I beg of thee, explain! What can it do?

    Edit: looks to be another text based one, not image generation right?

    • just_another_person@lemmy.worldOP
      link
      fedilink
      English
      arrow-up
      3
      ·
      6 months ago

      It’s language only, hence, LM

      • GaMEChld@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        6 months ago

        To be fair, I didn’t know if that language included programming language, and thus maybe still consider image based AI to be included in LLM. Is there a different designation for the type of AI that does image generation?

        • just_another_person@lemmy.worldOP
          link
          fedilink
          English
          arrow-up
          3
          ·
          6 months ago

          Yes: https://www.hachi-x.com/en/single-post/differences-between-llm-vlm-lvm-lmm-mllm-generative-ai-and-foundation-models

          • GaMEChld@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            6 months ago

            Nice, thanks!

  • werefreeatlast@lemmy.worldBanned
    link
    fedilink
    English
    arrow-up
    1
    arrow-down
    3
    ·
    6 months ago

    It knows everything about everything you ever received by mail from your local grocery store.

    Can it learn my local database of PDF books I illegally downloaded years ago? No!

    That’s right! Isn’t it great?

    • just_another_person@lemmy.worldOP
      link
      fedilink
      English
      arrow-up
      2
      ·
      6 months ago

      Huh?

Linux@lemmy.world

linux@lemmy.world

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !linux@lemmy.world

Welcome to c/linux!

Welcome to our thriving Linux community! Whether you’re a seasoned Linux enthusiast or just starting your journey, we’re excited to have you here. Explore, learn, and collaborate with like-minded individuals who share a passion for open-source software and the endless possibilities it offers. Together, let’s dive into the world of Linux and embrace the power of freedom, customization, and innovation. Enjoy your stay and feel free to join the vibrant discussions that await you!

Rules:

  1. Stay on topic: Posts and discussions should be related to Linux, open source software, and related technologies.

  2. Be respectful: Treat fellow community members with respect and courtesy.

  3. Quality over quantity: Share informative and thought-provoking content.

  4. No spam or self-promotion: Avoid excessive self-promotion or spamming.

  5. No NSFW adult content

  6. Follow general lemmy guidelines.

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 1 user / day
  • 102 users / week
  • 358 users / month
  • 1.55K users / 6 months
  • 1 local subscriber
  • 12.9K subscribers
  • 699 Posts
  • 2.07K Comments
  • Modlog
  • mods:
  • MigratingtoLemmy@lemmy.world
  • BE: 0.19.12
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org