https://github.com/ggml-org/llama.cpp

Install

brew install llama.cpp

That’s it. Metal support is included. Verify with:

llama-cli --version

---

Directory Structure

Set up a clean home for models and logs, separate from the brew-managed binaries:

mkdir -p ~/llm/models
mkdir -p ~/llm/logs

~/llm/
├── models/       # GGUF model files
├── logs/         # server logs
└── models.md     # manifest — track model source, quant, size

A minimal models.md entry:

| File                          | Source                  | Quant   | Size  |
|-------------------------------|-------------------------|---------|-------|
| llama-3.2-8b-q4_k_m.gguf     | bartowski/HF            | Q4_K_M  | 4.9GB |

---

Maintenance

# Update
brew upgrade llama.cpp

# Check current version
brew info llama.cpp

# Full removal (leaves ~/llm untouched)
brew uninstall llama.cpp