Description
You want to use Apple's built-in on-device models, but existing code is all written against the OpenAI API. This project bridges it: an open-source service that wraps Apple on-device models behind an OpenAI-compatible API, run an OpenAI-compatible server locally backed by Apple's on-device models, so code that called OpenAI works with local models almost unchanged, free and private. A macOS app, open source.
On-device models: Use Apple's on-device models.
OpenAI-compatible: Exposes an OpenAI-compatible API.
Runs locally: Runs on-device, no cloud.
Open and free: An open-source project, free to use.
Features
On-device models: Use Apple's on-device models.
OpenAI-compatible: Exposes an OpenAI-compatible API.
Runs locally: Runs on-device, no cloud.
Open and free: An open-source project, free to use.
