Back to the radar
EngineeringAnnouncement

How to Build a Model Router in the Harness

The essentials, the implications, and the sources behind the story.

01 / The short version

What happened

LangChain built a model router for Open SWE to cut costs by 64% without quality loss. The router classifies tasks by complexity using Jev and routes them to one of three tiers: GPT-6 Astra, GPT-5.6 Sol, or GLM-5.3-Flash. It uses LangSmith data to define criteria based on task type, cost, and turn count. Routing happens at thread start via middleware, keeping it task-specific and harness-integrated.

See the exact references

02 / Key takeaways

What you need to know

  1. 01

    Routing reduced median cost per thread by 64% with no measurable quality drop.

  2. 02

    Three model tiers were selected based on Pareto efficiency across intelligence and cost.

  3. 03

    Task classification uses Jev for speed and is integrated into the agent harness, not a generic gateway.

Keep in perspective

What to watch for

Performance and pricing claims are attributed to LangChain; independent validation of the 64% cost reduction or quality metrics is not provided.

Go to the source

Exact references

These are the original pages used for this brief. Publisher claims are not independent evaluations.

01Primary source · LangChainRead the original announcementhttps://www.langchain.com/blog/how-to-build-a-model-router-in-the-harness

AI-generated from the linked source. It can miss context; verify consequential details in the original. How the radar works