Is anyone using Ollama for anything these days? I almost never think about running locally since meh whats another API call, but sometimes I just wonder.
commit b8ab36e
I use it for a couple of things, but honestly, I ended up signing up for Ollama Cloud. The idea of running models locally sounds great until you need it to get things done. It's so slow. If I were working "offline" or didn't have tokens, I wanted to burn it's still there, but in…
Not quite the same thing, but "Real Soon Now™" I intend to set up Home Assistant with a local AI to move off of outside services. For code and work, I'm happy to pay for a great service. But I would like some things to be internal.