Local LLM Software: 68 Free Downloads
Every program tagged "Local LLM" on LvRuan, newest first, each with an overview, screenshots and a download link.
Cerno
Local-first agentic deep research
apfel
The free AI already on your Mac
esp32-ai
A 28.9M LLM running on an ESP32
Skales
Personal AI agent on every platform
PicoLM
A 1B LLM on a $10 board with 256MB RAM
ODS
Turn your PC into a private AI server
Claude Code Local
Run Claude Code fully on-device on a Mac
Soup
Fine-tune LLMs from one YAML
LocalGPT
Build explorable 3D worlds with natural language
colibri
Frontier MoE models on hardware you own
vMLX
MLX inference server for Apple Silicon
Pythia
Live world state and forecasts in one local API
AI File Sorter
AI content-aware file organizer and renamer
Gemma Translator
Fully offline handheld voice translator
Parlor
On-device real-time multimodal AI
kimi-k3-in-c
A 2.78T model on one CPU in 8GB RAM
Flash-MoE
Run a 397B model on a laptop
Be More Agent
Offline voice AI agent on a Raspberry Pi
llmfit
Find which LLMs your hardware can run
Lexicon
Offline local AI writing assistant