ML Infrastructure Engineer

Strativ Group

Menlo Park (CA)

On-site

USD 250,000 - 320,000

Full time

14 days+
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

A leading AI lab in Menlo Park is seeking a Staff Infrastructure Engineer to architect and build the compute substrate for next-generation AI systems. The ideal candidate has 5+ years in Software / ML Infrastructure Engineering, with deep experience in distributed systems and GPU orchestration. Join a team pushing the boundaries of real-time generative models with a focus on low-latency performance and scalability.

Qualifications

  • 5+ years of experience in Software / ML Infrastructure Engineering.
  • Deep experience with distributed systems and GPU orchestration for high‑performance ML workloads.
  • Proficiency in Python, Go, or similar, and strong grasp of software engineering best practices.
  • Hands‑on expertise with Kubernetes, Docker, and IaC (Terraform).
  • Experience optimizing model serving and data pipelines for latency and scalability.

Responsibilities

  • Work directly with founders to architect and build the compute substrate.
  • Design and optimize the inference platform and GPU-based training clusters.
  • Play a key role in scaling systems for research and production.

Skills

Distributed systems
GPU orchestration
Python
Go
Kubernetes
Docker
Infrastructure as Code (Terraform)

Job description

Staff Infrastructure Engineer

We are partnered with a Stealth AI Lab (backed by top-tier investors and advised by pioneering figures in generative and interactive media) that is hiring a Staff Infrastructure Engineer. The company pushes the boundaries of real-time generative models, building the core infrastructure that enables next‑generation video AI. Their work sits at the intersection of generative media, simulation, and multimodal interaction, redefining how humans and AI co‑create across gaming, film, education, and immersive content.

As a Staff Infra Engineer, you will work directly with the founders to architect, build, and scale the compute substrate that powers this next generation of AI. You’ll design and optimize the inference platform, GPU‑based training clusters, and data processing pipelines that drive real‑time creativity and discovery. You’ll play a key role in scaling systems for both research and production—ensuring low‑latency performance, high availability, and efficient utilization across petabyte‑scale data and model‑serving workloads.

Pay Range

$250,000.00/yr - $320,000.00/yr

Key Experience Required
  • 5+ years of experience in Software / ML Infrastructure Engineering.
  • Deep experience with distributed systems and GPU orchestration for high‑performance ML workloads.
  • Proficiency in Python, Go, or similar, and strong grasp of software engineering best practices.
  • Hands‑on expertise with Kubernetes, Docker, and IaC (Terraform).
  • Experience optimizing model serving and data pipelines for latency and scalability.
  • A builder’s mindset — you thrive in ambiguity, pick the right tools for the job, and ship.

Seniority level: Mid‑Senior level. Employment type: Full‑time. Job function: Information Technology.

This is a chance to join a team working at the frontier of real‑time AI systems — please apply ASAP for more info.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Member of Technical Staff
Member of Technical Staff

Harrison Clarke • San Francisco (CA)

On-site
USD 180,000 - 280,000
Machine Learning Engineer
Machine Learning Engineer

Goliath Partners Inc. • San Francisco (CA)

On-site
USD 150,000 - 210,000
ML Infrastructure Engineer
ML Infrastructure Engineer

Objective Partners • San Francisco (CA)

On-site
USD 180,000 - 250,000
Full medical, dental, vision coverage
Flexible PTO
Daily catered lunches
+1
Machine Learning Infrastructure Engineer
Machine Learning Infrastructure Engineer

Alexander Chapman Ltd • New York (NY)

On-site
USD 120,000 - 170,000
Health insurance
Competitive equity
Principal ML Infrastructure Engineer (Relocation Available)
Principal ML Infrastructure Engineer (Relocation Available)

Franklin Fitch • Dallas (TX)

On-site
USD 100,000 - 140,000
Software Engineer - ML Infrastructure
Software Engineer - ML Infrastructure

Arena Intelligence, Inc. • San Francisco (CA)

On-site
USD 180,000 - 230,000
Competitive compensation & equity
Health benefits
Cutting-edge AI work
+1
Senior Software Engineer, ML Infrastructure
Senior Software Engineer, ML Infrastructure

LMArena • San Francisco (CA)

On-site
USD 170,000 - 260,000
Competitive compensation
Comprehensive health benefits
Opportunity to work on cutting-edge AI
+1
Senior Software Engineer, Infrastructure Software for AI (Centralized AI Data Centers & Distrib[...]
Senior Software Engineer, Infrastructure Software for AI (Centralized AI Data Centers & Distrib[...]

Intelliswift - An LTTS Company • Sunnyvale (CA)

On-site
USD 120,000 - 150,000
Competitive salary
Health insurance
Flexible work hours
Software Engineer, AI Infra
Software Engineer, AI Infra

Makers Fund • Palo Alto (CA)

On-site
USD 180,000 - 240,000
Equity
Health benefits
Monthly stipends
+1
Member of Technical Staff (AI Infrastructure Engineer)
Member of Technical Staff (AI Infrastructure Engineer)

Perplexity • Palo Alto (CA)

On-site
USD 220,000 - 405,000