Getting started with local LLMs
I’ve recently dove headfirst into running LLMs on my local hardware, and I wanted to share what I’ve learned and how I’ve set it up so others that want to do the same thing, may. If you’re on a Windows Desktop machine, and you just want to interact with LLMs on your desktop, then skip to the section about installing Ollama. Hardware When it comes to the hardware, I utilized my media PC that had mostly been sitting dormant....