KoboldCpp

KoboldCpp

Easy local AI text generation

Description

Running GGUF/GGML models locally for text generation and role-play is full of setup pitfalls. KoboldCpp runs from one file: easy-to-use AI text-generation software for GGML and GGUF models, inspired by the original KoboldAI.

Features



Local Generation: Run GGUF/GGML models.

Ready to Run: Single-file launch.

Web UI: Browser-based generation.

Open Source: Free and local.