Why run AI on your own machine?
- Private — nothing leaves your computer. Good for sensitive notes or client info.
- Free — no monthly subscription.
- Offline — once it's set up, it works without internet.
The trade-off: it runs on *your* hardware, so it's a bit slower than the big cloud tools and the models are smaller. For most everyday tasks, that's perfectly fine.
What you need
A computer with at least 8 GB of RAM (16 GB or more is better). A recent Mac, or a Windows/Linux PC. A graphics card (GPU) makes it faster but isn't required.
The easiest way: Ollama
- Go to ollama.com and download the installer for your system (Mac, Windows, or Linux).
- Run the installer like any normal app.
- Open your Terminal (Mac/Linux) or Command Prompt / PowerShell (Windows).
- Type
ollama run llama3and press Enter. The first time, it downloads the model (a few GB) — give it a few minutes. - When it finishes you'll see a prompt. Type a question, press Enter, and you're running AI on your own machine.
To leave, type /bye. To start again later, open the terminal and type ollama run llama3 again.
Prefer clicking over typing? Use LM Studio
lmstudio.ai is a free app with a friendly window — browse models, click download, and chat in a normal interface. Great if the command line feels intimidating.
Which model should you download?
Start with a small, general model like Llama 3 or Gemma. If your computer struggles, pick a smaller version (look for "mini" or a small size like 3B). If it runs fast, try a bigger one for better answers.
Your next step
See Which AI Model Should You Use? to match a model to the task.