I’m still skeptical of large language models and AI tools in general, but I have recently started toying around with running Ollama locally on my Framework 13. Setup is pretty easy and the performance is quite good — I’ve been primarily using Llama 3.2.
I’m mostly interested in the tooling at the moment and it can be setup on your own machine. I still haven’t seen anything that knocks my socks off, but maybe I’ll find some practical use for it at some point.
➝ Source: ollama.com
