Product Manager, Compute Platform
San Francisco, CA | New York City, NY | Seattle, WA
Captured source
source ↗Job Application for Product Manager, Compute Platform at Anthropic
Product Manager, Compute Platform San Francisco, CA | New York City, NY | Seattle, WA
About Anthropic
Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.
About the role
As a Product Manager focused on Compute Platform, you’ll partner with Infrastructure, Compute Operations, Engineering, Finance & Strategy, and Research to build the scheduling, orchestration, and capacity management systems that power Anthropic’s compute infrastructure—the foundation on which every model training run, evaluation, and inference workload depends:
Partner with Infrastructure to build the systems that determine how jobs are scheduled, prioritized, and allocated across Anthropic’s growing fleet of GPU and accelerator clusters—ensuring the right workloads run on the right hardware at the right time.
Your work directly impacts cluster utilization, cost efficiency, and researcher velocity: defining the semantic layer for job scheduling, establishing resource guarantees, and making the trade-offs that keep our infrastructure running at peak capacity.
You’ll drive the evolution of our compute platform to support increasingly diverse workloads—from large-scale training runs and fine-tuning jobs to real-time inference and batch evaluation—each with distinct scheduling requirements, priority levels, and resource profiles.
You will define and own the strategy and roadmap across job scheduling primitives, capacity allocation policies, preemption and fairness frameworks, quota management, and the observability tooling that gives engineering and leadership confidence in how compute resources are being used.
Responsibilities:
Deeply understand the needs of internal customers across Research, Infrastructure, Product, and Finance—from researchers who need guaranteed resources for multi-week training runs to platform teams managing inference workloads with strict latency SLAs.
Define and iterate on the semantic layer for job scheduling: the abstractions, priority tiers, resource classes, and preemption policies that govern how work flows through our compute clusters.
Partnering with engineering leads to design scheduling capabilities that maximize cluster utilization while honoring resource guarantees—ensuring jobs have the right prerequisites (data, checkpoints, hardware affinity) validated before launch to avoid wasted compute.
Drive product strategy and roadmap for compute capacity management, including quota systems, fairness policies, bin-packing optimizations, and gang-scheduling for distributed workloads.
Own the trade-off framework between utilization efficiency, job latency, cost, and reliability—making transparent prioritization decisions and communicating them clearly to senior leadership.
Collaborate with the Capacity Strategy & Operations team on capacity planning models, demand forecasting, and cost-to-serve analytics that inform infrastructure investment decisions.
Build and champion observability tools and dashboards that provide real-time visibility into cluster health, queue depth, scheduling efficiency, and resource waste.
You may be a good fit if you have:
7+ years of product management experience, with deep exposure to compute infrastructure, distributed systems, or scheduling/orchestration platforms
Experience taking technical infrastructure products from infancy to scale—you’ve built something from the ground up and grown it to serve demanding internal or external customers
Track record of building platform products that balance the needs of multiple users and stakeholders—you’re comfortable making prioritization trade-offs between utilization, latency, cost, and fairness, and communicating them clearly
Ability to internalize complex technical systems (job schedulers, cluster managers, resource orchestrators) and translate that understanding into a comprehensive product vision
Fluent across functions—you’re equally credible discussing scheduling algorithms with engineers, capacity economics with finance, and infrastructure strategy with leadership
Strong instinct for connecting technical decisions to business outcomes: every percentage point of cluster utilization has measurable impact
Scrappy and resourceful—you do what it takes to get things done in a fast-moving environment
Strong candidates may have:
Built or scaled job scheduling, resource orchestration, or workload management systems for large-scale compute clusters (e.g., Kubernetes, Slurm, Borg, YARN, or custom schedulers).
Deep familiarity with GPU/accelerator scheduling challenges, including gang-scheduling, topology-aware placement, preemption, and hardware affinity constraints.
Experience defining and enforcing SLAs and resource guarantees for compute workloads—including mechanisms to validate job prerequisites (data readiness, checkpoint availability, hardware compatibility) before scheduling to avoid wasted resources.
Capacity planning experience across cloud and on-premises infrastructure, including cost modeling, demand forecasting, and vendor management for compute procurement.
Scaled through hypergrowth in compute-intensive environments (AI/ML, HPC, large-scale cloud infrastructure).
Experience with observability and efficiency tooling for distributed infrastructure—building dashboards, automation, and governance workflows that drive utilization and cost accountability.
The annual compensation range for this role is listed below.
For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.
Annual Salary: $305,000 - $385,000 USD
Logistics
Minimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience
Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience
Minimum years of experience: Years of experience required will correlate with the internal job level requirements for the position
Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time. However,…
Excerpt shown — open the source for the full document.
Notability
notability 3.0/10Routine job posting at AI lab.
Anthropic has a job signal matching infrastructure, product and customer.