Senior Machine Learning Engineer

Strativ Group

Palo Alto (CA)

On-site

USD 600,000 - 1,000,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Strativ Group in Palo Alto is building a seed-stage AI infrastructure company focused on high-performance inference on TPUs and GPUs, with a longer-term goal of an agent cloud where models and agents can improve themselves. Engineers will work directly with founders to shape architecture and direction from day one.

The role covers ML systems, distributed systems and AI infrastructure with potential work on low-level serving or infrastructure for autonomous, self-improving workloads.

Qualifications

  • Strong background in at least one area: ML systems/AI infrastructure, model inference/serving, distributed training/inference, GPU/TPU systems, scheduling/runtimes or compiler-level optimization.

Responsibilities

  • Build and optimize production infrastructure for large-scale AI workloads.
  • Work on ML systems, distributed systems and AI infrastructure.
  • Own significant pieces of the system from day one.
  • Focus on low-level serving and runtime performance or infrastructure for autonomous agent workloads.
  • Improve latency, throughput and infrastructure costs.
  • Enhance reliability, observability and deployment of AI workloads.

Job description

We are working with a seed-stage AI infrastructure company in Palo Alto that is building optimization tools to change how models are served. Their current focus is high-performance inference on TPUs and GPUs, and the longer-term goal is an agent cloud where models and agents can improve themselves. The founding team is small, and the engineers who join now will work directly with the founders and shape both the architecture and the direction of the company.

About the Role

You will build and optimize the production infrastructure that runs large-scale AI workloads. The role covers ML systems, distributed systems and AI infrastructure, and the scope is wide. Depending on your interests, you might spend your time on low-level serving and runtime performance, or on the infrastructure that long-running, self-improving agents need to operate. You will own significant pieces of the system from your first day.

What You Will Work On

  • High-performance inference on TPUs and GPUs
  • Distributed model serving and scheduling
  • Runtime and systems optimization
  • Latency, throughput and infrastructure cost
  • Reliability, observability and deployment
  • Infrastructure for increasingly autonomous, agentic workloads

What They Are Looking For

You do not need experience across the whole stack. You should have a strong background in at least one of these areas:

  • ML systems or AI infrastructure
  • Model inference and serving
  • Distributed training or inference
  • GPU or TPU systems
  • Scheduling, runtimes or compiler-level optimization

Compensation

  • Total compensation: up to $1M+, combining cash and founding equity
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Machine Learning Systems Engineer
Machine Learning Systems Engineer

Strativ Group • Palo Alto (CA)

On-site
USD 450,000 - 550,000
Founding equity
Direct exposure to founders
Competitive compensation
Founding Machine Learning Infrastructure Engineer
Founding Machine Learning Infrastructure Engineer

Peano AI • Palo Alto (CA)

On-site
USD 180,000 - 260,000
Machine Learning Engineer
Machine Learning Engineer

Harrison Clarke • San Francisco (CA)

On-site
USD 180,000 - 260,000
Member of Technical Staff
Member of Technical Staff

Harrison Clarke • San Francisco (CA)

On-site
USD 180,000 - 280,000
Machine Learning Engineer
Machine Learning Engineer

Goliath Partners Inc. • San Francisco (CA)

On-site
USD 180,000 - 240,000
ML Infrastructure Engineer
ML Infrastructure Engineer

Objective Partners • San Francisco (CA)

On-site
USD 180,000 - 250,000
Full medical, dental, vision coverage
Flexible PTO
Daily catered lunches
+1
Staff / Principal Machine Learning Engineer, Serving
Staff / Principal Machine Learning Engineer, Serving

Inworld AI • Mountain View (CA)

On-site
USD 270,000 - 500,000
Relocation assistance
Equity options
Comprehensive benefits package
System Software Engineer - AI
System Software Engineer - AI

Delos Data Inc • Palo Alto (CA)

On-site
USD 140,000 - 200,000
Equity
401k
Benefits
Machine Learning Infrastructure Engineer
Machine Learning Infrastructure Engineer

True Talent Solutions Partners • United States

Remote
USD 200,000 - 400,000
Senior ML Systems Engineer: High-Perf Inference & Infra
Senior ML Systems Engineer: High-Perf Inference & Infra

Strativ Group • Palo Alto (CA)

On-site
USD 600,000 - 1,000,000