Description
Sending everything to the priciest model wastes money, and small models flunk hard questions. LLMRouter is an open-source library that routes each query to the right LLM.
It includes many routing algorithms and lets you train and evaluate routers to balance quality and cost.
Routing:Per query.
Algorithms:Trainable.
Cost:Balanced.
It includes many routing algorithms and lets you train and evaluate routers to balance quality and cost.
Features
Routing:Per query.
Algorithms:Trainable.
Cost:Balanced.
