Flow
Decisions

0098 — Broker picks a cheaper model for the request

Opted-in people can have a relay call sent to a cheaper model in the same family.

Decided. When a person is opted in, relay asks a cheap model on the same provider whether the request needs a light, standard, or frontier model, then substitutes a cheaper catalog model in that family when it still fits. A static routing rule wins first. A failed classification keeps the model the caller asked for.

Broker does not know job titles. The flag defaults off. A platform admin turns it on per email.

The classifier's tokens are their own usage row. Routing savings on the main call stay the requested price minus the actual cost.

Canonical source: docs/decisions/0098-broker-picks-a-cheaper-model-for-the-request.md.