Tag: llm

6 results

Run and train LLMs locally

Tiny decision model answering in one pass

A 27B model in ternary weights at 5.9 GB

Local decision model that reads option probabilities directly

LLM API gateway and distribution

Run LLMs Locally