Do you host your own ML / AI / LLM? What do you use, and what do you use it for?

  • curbstickle@anarchist.nexusM
    link
    fedilink
    English
    arrow-up
    2
    ·
    3 hours ago

    Apple silicon is pretty good at it as long as you’ve got the ram for it. I wouldn’t do less than 16GB.

    A few seconds for most of the tasks