Local LLM Software: 68 Free Downloads
Every program tagged "Local LLM" on LvRuan, newest first, each with an overview, screenshots and a download link.
OpenLLM
Run open LLMs as OpenAI-compatible APIs
Amical
Open source, local-first AI dictation
Vosk
Offline speech recognition for many platforms
MNN
Lightweight on-device inference engine
Dot
Local RAG, LLM and TTS app
ZSE
Open source LLM inference engine
Hunyuan3D 2 Windows整合包
Portable Hunyuan3D package for Windows
TriAttention
Efficient long reasoning with trigonometric KV compression
Wan 2.2
Open advanced video generation models
Qbot
AI-powered quantitative investment research platform
OpenMonoAgent
Terminal coding agent powered by local LLMs
Local Voice AI
Private, low-latency local voice assistant
WhisperLiveKit
Real-time local speech-to-text with diarization
LLM Checker
Find which LLMs your hardware can run
MOSS-TTS-Nano
100M-parameter real-time CPU TTS
KupkaProd Cinema Pipeline
Fully local autonomous AI movie studio
Parallax
Distributed model serving on your own cluster
Local-NotebookLM
Google's NotebookLM, but local
AgenticSeek
Fully local Manus alternative
Knowledge Graph Builder
Build knowledge graphs from text with LLMs