minus-squareBeefAndPoultry@lemmus.orgtoSelf Hosted - Self-hosting your services.@lemmy.ml•Seeking Architecture Advice for a Self-Hosted 24/7 Radio ShowlinkfedilinkEnglisharrow-up3·1 month agoI would suggest using llama.cpp instead of Ollama, or maybe Unsloth Studio https://sleepingrobots.com/dreams/stop-using-ollama/ !localllama@sh.itjust.works linkfedilink
I would suggest using llama.cpp instead of Ollama, or maybe Unsloth Studio
https://sleepingrobots.com/dreams/stop-using-ollama/
!localllama@sh.itjust.works