Glossary
Model routing
Sending each AI request to the model best suited to it, by difficulty, cost, speed or data rules.
Model routing is the technique of choosing, for each request, which AI model should handle it. A router looks at the task, such as its difficulty, topic, length or data sensitivity, and sends it to a small, fast model or a larger, stronger one. Teams use it to control cost and latency, add fallbacks when a provider fails and keep sensitive data on approved models.
A simple router is a set of rules: classification tasks go to a small model, long reasoning goes to a frontier model. More advanced routers use a classifier or a small model to score difficulty. Many gateways also add automatic fallback to a second provider.
Routing adds a moving part, so it should earn its place. It pays off when traffic is high and tasks vary in difficulty. Test the router on your own data, since a bad routing choice quietly lowers quality.
Start in 60 seconds
Put this to work on your project.
Get an AI-assisted, architect-reviewed scope, cost range, and timeline. Free, no login.