GPU Inference Capacity Optimization Scientist

openai; San Francisco (CA); On-site; USD 293,000 - 325,000; Full time

Job summary

OpenAI is seeking a Data Scientist to partner with Capacity Systems Engineering, Infrastructure, Product, and Research to optimize inference capacity across our global GPU fleet. You will transform complex operational data into actionable insights that influence how we allocate and scale one of the world's largest AI compute environments.

You will build models to profile GPU utilization, develop forecasting for inference demand, and design experiments to evaluate scheduling policies and

Qualifications

• MS or PhD in statistics, CS, OR, applied math, economics, or related quantitative field.
• 5+ years of experience in the infrastructure data science space.
• Strong Python and SQL expertise.
• Experience in forecasting, optimization, or predictive models.
• Strong understanding of experimentation, statistical inference, and causal analysis.
• Experience communicating insights to executive stakeholders.

Responsibilities

• Build statistical and ML models to profile GPU utilization, latency, throughput, and fleet efficiency.
• Develop forecasting models for inference demand across products, regions, and model families.
• Analyze workloads to identify latency bottlenecks and capacity constraints.
• Inform infrastructure planning and long-term GPU investment strategies with Capacity Systems Engineering.
• Design experiments and simulations to evaluate scheduling policies and tradeoffs.
• Build dashboards and metrics for data-driven capacity decisions by leadership.
• Collaborate with Product, Research, Finance, and Infrastructure teams to align compute planning with roadmaps.
• Communicate technical findings clearly to engineering teams and executives.

Skills

Python

SQL

Forecasting

Statistical inference

Causal analysis

Executive communication

Education

MS or PhD in Statistics, Computer Science, Operations Research, Applied Mathematics, Economics, or related quantitative discipline

Tools

Python

SQL

Job description

OpenAI is seeking a Data Scientist to partner with Capacity Systems Engineering, Infrastructure, Product, and Research to optimize inference capacity across our global GPU fleet. You will transform complex operational data into actionable insights that influence how we allocate and scale one of the world's largest AI compute environments.

You will build models to profile GPU utilization, develop forecasting for inference demand, and design experiments to evaluate scheduling policies and