Do you host your own ML / AI / LLM? What do you use, and what do you use it for?

  • Nednarb44@lemmy.world
    link
    fedilink
    English
    arrow-up
    10
    arrow-down
    4
    ·
    8 hours ago

    I do, I use ollama. I mostly just tinker, but I use with with home assistant for a quasi Alexa like experience with the voice assistant, I use it for summarizing some YouTube transcripts in too lazy to read/watch, and I’ve tried to see how capable it is with coding.

    • diminou@lemmy.zip
      link
      fedilink
      English
      arrow-up
      4
      arrow-down
      2
      ·
      8 hours ago

      Can you elaborate on what you are using exactly with home assistant ? And is English your primary language in that context ?

      Trying to do something similar, English not primary and its a bit… Harder than it seems. Can’t figure out if it is because I’m not using English or something else. (3060 12GB BTW)

      • Nednarb44@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        2
        ·
        7 hours ago

        English is my primary, so that does make it easier. I use it for general conversion things, like asking it questions about the Titanic or making up a new story or something. It doesn’t work as well as I’d like yet, but like I said, it’s just an other thing for me to mess around with and change.