Do you host your own ML / AI / LLM? What do you use, and what do you use it for?

  • Lettuce eat lettuce@lemmy.ml
    link
    fedilink
    English
    arrow-up
    6
    arrow-down
    2
    ·
    6 hours ago

    What local models have you been using? And what hardware are you running them on? I’ve been playing with local LLMs a bit for exactly your use case.

    I have zero interest in vibe coding or full agentic workflows. But having a local LLM generate a Bash script to help me automate parts of my home lab infrastructure would be nice.