Big day for people who use AI locally. According to benchmarks this is a big step forward to free, small LLMs.

  • brucethemoose@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    5 months ago

    Llama 70B is probably where its at, if you go the API route. It’s distilled from 405B, and its benchmarks are pretty close.