ML Infrastructure Engineer

Strativ Group

Menlo Park (CA)

On-site

USD 250,000 - 320,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

A leading AI lab in Menlo Park is seeking a Staff Infrastructure Engineer to architect and build the compute substrate for next-generation AI systems. The ideal candidate has 5+ years in Software / ML Infrastructure Engineering, with deep experience in distributed systems and GPU orchestration. Join a team pushing the boundaries of real-time generative models with a focus on low-latency performance and scalability.

Qualifications

  • 5+ years of experience in Software / ML Infrastructure Engineering.
  • Deep experience with distributed systems and GPU orchestration for high‑performance ML workloads.
  • Proficiency in Python, Go, or similar, and strong grasp of software engineering best practices.
  • Hands‑on expertise with Kubernetes, Docker, and IaC (Terraform).
  • Experience optimizing model serving and data pipelines for latency and scalability.

Responsibilities

  • Work directly with founders to architect and build the compute substrate.
  • Design and optimize the inference platform and GPU-based training clusters.
  • Play a key role in scaling systems for research and production.

Skills

Distributed systems
GPU orchestration
Python
Go
Kubernetes
Docker
Infrastructure as Code (Terraform)

Job description

Staff Infrastructure Engineer

We are partnered with a Stealth AI Lab (backed by top-tier investors and advised by pioneering figures in generative and interactive media) that is hiring a Staff Infrastructure Engineer. The company pushes the boundaries of real-time generative models, building the core infrastructure that enables next‑generation video AI. Their work sits at the intersection of generative media, simulation, and multimodal interaction, redefining how humans and AI co‑create across gaming, film, education, and immersive content.

As a Staff Infra Engineer, you will work directly with the founders to architect, build, and scale the compute substrate that powers this next generation of AI. You’ll design and optimize the inference platform, GPU‑based training clusters, and data processing pipelines that drive real‑time creativity and discovery. You’ll play a key role in scaling systems for both research and production—ensuring low‑latency performance, high availability, and efficient utilization across petabyte‑scale data and model‑serving workloads.

Pay Range

$250,000.00/yr - $320,000.00/yr

Key Experience Required
  • 5+ years of experience in Software / ML Infrastructure Engineering.
  • Deep experience with distributed systems and GPU orchestration for high‑performance ML workloads.
  • Proficiency in Python, Go, or similar, and strong grasp of software engineering best practices.
  • Hands‑on expertise with Kubernetes, Docker, and IaC (Terraform).
  • Experience optimizing model serving and data pipelines for latency and scalability.
  • A builder’s mindset — you thrive in ambiguity, pick the right tools for the job, and ship.

Seniority level: Mid‑Senior level. Employment type: Full‑time. Job function: Information Technology.

This is a chance to join a team working at the frontier of real‑time AI systems — please apply ASAP for more info.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

AI/ML Infra Engineer - Hosting
AI/ML Infra Engineer - Hosting

Hamilton Barnes Associates Limited • San Francisco (CA)

On-site
USD 225,000 - 275,000
Stock options
AI Infrastructure / ML Infrastructure Engineer
AI Infrastructure / ML Infrastructure Engineer

DeWinter Group • Campbell (CA)

On-site
Principal ML Infrastructure Engineer (Relocation Available)
Principal ML Infrastructure Engineer (Relocation Available)

Franklin Fitch • Dallas (TX)

On-site
USD 100,000 - 140,000
Staff Software Engineer (AI Infrastructure)
Staff Software Engineer (AI Infrastructure)

DeepRec.ai • Palo Alto (CA)

On-site
USD 180,000 - 320,000
Senior Software Engineer, ML Infrastructure
Senior Software Engineer, ML Infrastructure

LMArena • San Francisco (CA)

On-site
USD 170,000 - 260,000
Competitive compensation
Comprehensive health benefits
Opportunity to work on cutting-edge AI
+1
Machine Learning Systems Engineer, Networking
Machine Learning Systems Engineer, Networking

NVIDIA • Santa Clara (CA)

On-site
USD 152,000 - 287,500
Senior Software Engineer, Infrastructure Software for AI (Centralized AI Data Centers & Distrib[...]
Senior Software Engineer, Infrastructure Software for AI (Centralized AI Data Centers & Distrib[...]

Intelliswift - An LTTS Company • Sunnyvale (CA)

On-site
USD 120,000 - 150,000
Competitive salary
Health insurance
Flexible work hours
Research Engineer, Infrastructure, Inference
Research Engineer, Infrastructure, Inference

Thinkingmachines • San Francisco (CA)

On-site
USD 350,000 - 475,000
Generous health, dental, and vision benefits
Unlimited PTO
Paid parental leave
+1
Member of Technical Staff (AI Infrastructure Engineer)
Member of Technical Staff (AI Infrastructure Engineer)

Pantera Capital • Palo Alto (CA)

Hybrid
USD 190,000 - 250,000
Comprehensive health insurance
Dental and vision insurance
401(k) plan
+1
Senior Software Engineer, ML Infrastructure
Senior Software Engineer, ML Infrastructure

Arena • San Francisco (CA)

On-site
USD 180,000 - 240,000
Competitive salary
Equity
Health benefits
+2