Topics

Local Models

Local-model agents run on a Mac mini, a GPU box or a home server, with no per-token bill and no data leaving the building. They suit background loops such as monitoring, triage and nightly reports, where a smaller open model is good enough.

Top use cases

Local Models FAQ

Do I need a powerful computer?

A Mac mini or a PC with a modern GPU runs useful 8B to 30B models. Bigger models need more memory.

Are local models as good as cloud models?

Not for everything. They are strong for routine loops; use a cloud model for hard reasoning.

Why run an agent locally?

Privacy, no per-token cost, and it can run 24/7 on your schedule.