Data Scientist — Inference Capacity & GPU Optimization

United States Digital Space LLC; United States; Remote; USD 140,000 - 230,000; Full time

Job summary

United States Digital Space LLC is seeking a Data Scientist to optimize inference capacity across a global GPU fleet. The role combines statistical modeling, large-scale data analysis, forecasting, and systems thinking to guide infrastructure investments and performance-efficiency trade-offs.

You will transform complex operational data into actionable insights that influence how the company scales one of the world’s largest AI compute environments.

Qualifications

• 5+ years of experience in infrastructure data science or equivalent.
• Strong expertise in Python and SQL.
• Experience building forecasting, optimization, or predictive models.
• Strong understanding of experimentation, statistical inference, and causal analysis.
• Experience communicating analytical insights to executive stakeholders.

Responsibilities

• Build statistical and machine learning models to profile and improve GPU utilization, latency, throughput, and fleet efficiency.
• Develop forecasting models for inference demand across products, regions, and model families.
• Analyze production workloads to identify latency bottlenecks and capacity constraints, highlighting optimization opportunities.
• Partner with Capacity Systems Engineering to inform infrastructure planning and long-term GPU investment strategies.
• Design experiments and simulations to evaluate scheduling policies, serving strategies, and infrastructure tradeoffs.
• Build dashboards and operational metrics that enable leadership to make data-driven capacity decisions.
• Collaborate with Product, Research, Finance, and Infrastructure teams to align compute planning with business growth and model roadmaps.
• Communicate technical findings clearly to both engineering teams and executive leadership.

Skills

Python

SQL

Forecasting

Experimentation

Causal analysis

Executive communication

Education

MS/PhD in quantitative field

Job description

United States Digital Space LLC is seeking a Data Scientist to optimize inference capacity across a global GPU fleet. The role combines statistical modeling, large-scale data analysis, forecasting, and systems thinking to guide infrastructure investments and performance-efficiency trade-offs.

You will transform complex operational data into actionable insights that influence how the company scales one of the world’s largest AI compute environments.