WritingBasetenBasetenpublished Nov 4, 2026seen 23h

Introducing Baseten Grid

Open original ↗

Captured source

source ↗
published Nov 4, 2026seen 23hcaptured 23hhttp 200method firecrawl

![](https://www.datocms-assets.com/104802/1793046443-rotate-device-icon.png)

Please rotate your device

To continue exploring this website, please rotate your device to a vertical orientation

Product

Introducing Baseten Grid

Put the right model to work on every task and cut AI coding spend, with intelligent routing, unified access, and enterprise control.

Authors

!Sai MaddaliSai Maddali

!Kenzie AmackKenzie Amack

Date

November 4, 2026

!Introducing Grid

TLDR

![](https://www.baseten.co/images/molecules/tldr-info.svg?dpl=dpl_Gudd1DhkwVkEDsJNk9KCXTrMVpAP)

Baseten Grid helps enterprises accomplish more with their AI spend. Grid is a single layer to route requests, monitor usage, and govern access. In early benchmarks, Grid cut cost per coding task by up to 70% with minimal quality loss. Grid is in public preview starting today.

AI coding spend has become one of the fastest-growing line items for enterprises. Over 90% of developers now use AI tools weekly, and as adoption has exploded, so have costs. Everyone wants AI to take on more demanding work, but that requires matching each task to the right level of intelligence. Thankfully, there are more options than ever: open models now match frontier-class performance on many tasks at up to 3x lower cost, sparing frontier models for the tasks that truly need them. The challenge is knowing which tasks need Astra vs. which are better for DeepSeek Flash.

Today, developers are left to make these decisions on their own, while platform teams juggle the models, harnesses, budgets, and policies that come with using many different providers and tools. Baseten Grid brings this into a single place: access open and closed models through one gateway, route requests based on your quality and performance requirements, and apply controls across your organization.

Baseten Grid: the enterprise control layer for internal coding

Baseten Grid helps enterprises get more useful work from their AI spend by bringing together three capabilities:

  • Intelligent Routing:selects the best-fit model for each request from your list of approved models. Our custom router, Baseten Router, considers expected task performance and cost, including retries, failed tool calls, and incomplete answers. In our benchmarks, Baseten Router has reduced cost per task by up to 70% with minimal quality loss.
  • Gateway: governs model access across closed- and open-source model providers, including OpenAI, Anthropic, Gemini Enterprise Agent Platform, Amazon Bedrock, and Baseten. View all your AI usage in one place, with team-level model access, budgets, and company-managed credentials.
  • Guardrails: brings configurable safety policies, and visibility into risks, centrally at the gateway layer so every request and response undergoes safety compliance in a single place.

!The Grid dashboard shows AI coding spend broken down by model, alongside total spend, token volume, cache hit rate, and cost saved.The Grid dashboard shows AI coding spend broken down by model, alongside total spend, token volume, cache hit rate, and cost saved.

Intelligent Routing: match every task to the right model

As AI adoption has surged, developers have carried the burden of matching models to tasks themselves. But the right answer changes constantly, which is why picking models can't be a manual chore. With the right intelligence, that decision can be made automatically and efficiently for developers, every time. Grid solves this with built-in intelligent routing via Baseten Router.

Baseten Router chooses between your approved open- and closed-source models based on expected performance and cost for each task. Intelligent routing goes beyond routing based on token price; it also accounts for the cost of retries and failed tool use. The goal is to reduce the cost of a complete task while meeting your team's quality and performance requirements.

In initial benchmarks, Baseten Router can achieve nearly 70% cost savings with only a 0.9- percentage-point quality tradeoff versus Opus 5.5 (exact cost savings will vary based on your team's workload shape and desired cost and quality tradeoffs). Teams can also opt in to sharing traces, which can be used to train custom routers for Pareto efficiency for your specific workload.

> " _Almost everyone at Opendoor uses AI, and most people don’t want to have to form an opinion on which model to pick. Grid has enabled us to get visibility into all our internal AI spend in a single place, and intelligent routing helps us cut spend automatically with minimal quality loss._" > > — Chintan Parikh, Head of Engineering, Opendoor

!Grid’s auto routes split each team’s requests across open and closed models according to your requirements: cost, intelligence, or a balance of both.Grid’s auto routes split each team’s requests across open and closed models according to your requirements: cost, intelligence, or a balance of both.

Gateway: one place to govern every model call

Grid’s Gateway gives organizations one place to approve models, manage access, set budgets, and understand usage across every team, application, and agent. Today, Grid supports models from OpenAI, Anthropic, Gemini Enterprise Agent Platform, Amazon Bedrock, and Baseten. Every request passes through a single gateway, built on our production infrastructure with the security and compliance you know from Baseten.

Developers connect the harnesses they already use - Claude Code, Codex, OpenCode, and Pi in a single command. Admins can also automate this configuration through an MDM. The same endpoint governs your in-house applications and agents: if it calls the Anthropic or OpenAI API, it can connect with a base URL and a model ID. You get the control and visibility of a centralized system without changing how your team...

Excerpt shown — open the source for the full document.

Notability

notability 6.0/10

Inference platform product launch, substantive but not frontier.