WritingBasetenBasetenpublished Mar 30, 2026seen Jun 26

Rolling Deployments

Open original ↗

Captured source

source ↗
published Mar 30, 2026seen Jun 26captured Jun 27http 200method plain

Rolling deployments Announcing our Series F . Learn more

changelog / post

Rolling deployments

Mar 30, 2026 Go back

You can now gradually shift traffic to new deployments instead of swapping all at once. Candidate replicas scale up incrementally while previous replicas scale down in controlled steps, giving you zero-downtime updates. Pause, resume, or cancel mid-rollout if you spot issues. Configure rollout speed with max_surge_percent and stabilization_time_seconds , and choose how to handle the previous deployment after promotion.

Enable rolling deployments in your environment's promotion settings in the dashboard, or through the API:

1 curl -X PATCH "https://api.baseten.co/v1/models/{model_id}/environments/{env_name}" \ 2 -H "Authorization: Api-Key $BASETEN_API_KEY" \ 3 -H "Content-Type: application/json" \ 4 -d '{ 5 "promotion_settings" : { 6 "rolling_deploy" : true , 7 "promotion_cleanup_strategy" : "SCALE_TO_ZERO" , 8 "rolling_deploy_config" : { 9 "max_surge_percent" : 10 , 10 "stabilization_time_seconds" : 300 11 } 12 } 13 }' For more information, see Rolling deployments .

Explore Baseten today Start deploying Talk to an engineer

Popular models GLM 5.2

Kimi K2.7 Code

DeepSeek V4

GPT OSS 120B

Whisper Large V3

NVIDIA Nemotron 3 Ultra

Explore all

Popular models GLM 5.2

Kimi K2.7 Code

DeepSeek V4

GPT OSS 120B

Whisper Large V3

NVIDIA Nemotron 3 Ultra

Explore all

Notability

notability 2.0/10

Routine blog post on deployment strategy, no traction.