Description
Running LLMs locally on iPhone means figuring out model conversion and the Neural Engine. CoreML-LLM offers a way to run LLMs on Apple devices with CoreML, optimized for the Neural Engine and GPU.
It includes conversion tools and Swift samples for smooth on-device inference.
Conversion:CoreML.
ANE:Neural Engine.
On-device:Offline.
Swift:Samples.
It includes conversion tools and Swift samples for smooth on-device inference.
Features
Conversion:CoreML.
ANE:Neural Engine.
On-device:Offline.
Swift:Samples.
