Local LLM Software: 68 Free Downloads
Every program tagged "Local LLM" on LvRuan, newest first, each with an overview, screenshots and a download link.
Strata
Run a 125B model on a gaming PC
FreeToken
Run massive MoE models locally on consumer hardware
Garden Desk
Free local desktop agent for your files
OpenJarvis
Personal AI on personal devices
Xinity AI
On-premise AI platform with zero data egress
mac code
Free local coding agent on your Mac
BenchLocal
Test LLMs on real tasks side by side
Qualcomm AI Hub Models
ML models optimized for Qualcomm devices
Axiom Voice Agent
Sub-400ms offline voice agent on 4GB VRAM
MiroFish Offline
Offline multi-agent simulation and prediction
llama-swap
Reliable model swapping for local LLM servers
AirLLM
70B inference with a single 4GB GPU
AMD R9700 AI Toolboxes
llama.cpp containers for AMD R9700 GPUs
Timber
Ollama for classical ML models
oMLX
LLM inference server for Apple Silicon
CoreML-LLM
Run LLMs on Apple devices with CoreML
MLX Studio
Easiest way to run LLMs on your Mac
ATLAS
Local coding agent for compact open models
effGen
Small language models as capable agents
Cactus
On-device AI inference for mobiles and wearables