• Sparky@lemmy.blahaj.zone
    link
    fedilink
    arrow-up
    2
    ·
    edit-2
    9 months ago

    Fun fact: you can download llama3, an llm model made by meta (which is surprisingly good for its size), and it’s only 4.7gb. A dvd can store 4.7 gb of data, meaning you could in theory have an llm on a DVD.

    Model link

    CC BY-NC-SA 4.0

  • neidu2@feddit.nl
    link
    fedilink
    arrow-up
    0
    ·
    edit-2
    9 months ago

    Technically possible with a small enough model to work from. It’s going to be pretty shit, but “working”.

    Now, if we were to go further down in scale, I’m curious how/if a 700MB CD version would work.

    Or how many 1.44MB floppies you would need for the actual program and smallest viable model.

    • Naz@sh.itjust.works
      link
      fedilink
      arrow-up
      1
      ·
      9 months ago

      squints

      That says , “PHILLIPS DVD+R”

      So we’re looking at a 4.7GB model, or just a hair under the tiniest, most incredibly optimized implementation of <INSERT_MODEL_NAME_HERE>