ML Infra Engineer: Scalable Training & Inference

Mixpeek

San Francisco (CA)

On-site

USD 180,000 - 240,000

Full time

10 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Trajectory is seeking an ML Infrastructure Engineer to join our research-driven team in San Francisco. You will own the innermost loop of our continual learning platform, spanning training, inference and kernels, and collaborate with researchers to translate new algorithms into reliable systems.

We value deep specialization in training infra, inference systems, or GPU kernels, strong Python and C++/CUDA/Triton skills, and the ability to deliver measurable performance gains while preserving

Qualifications

  • Strong fundamentals in distributed systems, networking, storage and failure recovery.
  • Deep specialization in one of training infrastructure, inference systems, or GPU kernels, supported by measurable optimizations.
  • Strong Python skills and languages relevant to your specialty, such as C++, CUDA, or Triton.
  • Understanding of PyTorch, JAX, or comparable framework internals, with strong profiling and debugging skills.
  • Ownership and clear communication: work closely with researchers and deliver measurable performance gains while preserving correctness and reliability.

Responsibilities

  • Build and optimize distributed training and RL infrastructure, including rollout execution, GPU scheduling, training parallelisms, checkpointing, and recovery.
  • Improve serving for production agents and training rollouts, balancing latency and throughput.
  • Develop and optimize GPU kernels and runtimes using CUDA, Triton, or comparable tools.
  • Build reproducible benchmarks, observability, and automated research workflows across training, inference, and kernels.

Skills

Distributed systems
Python
C++/CUDA/Triton
PyTorch/JAX internals
Communication/ownership

Tools

Miles
SkyRL
vLLM
SGLang
ML compilers

Job description

Trajectory is seeking an ML Infrastructure Engineer to join our research-driven team in San Francisco. You will own the innermost loop of our continual learning platform, spanning training, inference and kernels, and collaborate with researchers to translate new algorithms into reliable systems.

We value deep specialization in training infra, inference systems, or GPU kernels, strong Python and C++/CUDA/Triton skills, and the ability to deliver measurable performance gains while preserving

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ML Infrastructure Engineer: Training, Inference & Kernels
ML Infrastructure Engineer: Training, Inference & Kernels

Trajectory • San Francisco (CA)

On-site
USD 150,000 - 230,000
ML Infra Engineer: Scale & Optimize Large-Scale Training
ML Infra Engineer: Scale & Optimize Large-Scale Training

Physical Intelligence • San Francisco (CA)

On-site
USD 180,000 - 240,000
Member of Technical Staff - ML Infra
Member of Technical Staff - ML Infra

Trajectory • San Francisco (CA)

On-site
USD 150,000 - 230,000
Member of Technical Staff - ML Infra
Member of Technical Staff - ML Infra

Mixpeek • San Francisco (CA)

On-site
USD 180,000 - 240,000
ML Infra Tech Lead: Scalable Training & Inference
ML Infra Tech Lead: Scalable Training & Inference

Reducto • San Francisco (CA)

On-site
USD 180,000 - 260,000
Unlimited PTO
Daily Lunch
Commuter Reimbursement
+3
ML Infra Engineer: Scale Training & Inference (Hybrid)
ML Infra Engineer: Scale Training & Inference (Hybrid)

Lattice, Inc. • San Francisco (CA)

Hybrid
USD 200,000 - 280,000
Competitive salary
Premium health, dental, and vision insurance
Unlimited PTO
+2
ML Infrastructure Engineer
ML Infrastructure Engineer

Lattice, Inc. • San Francisco (CA)

On-site
USD 200,000 - 280,000
Competitive salary
Premium health, dental, and vision insurance
Unlimited PTO
+2
ML Infra Engineer: Scale GPU Training & Inference
ML Infra Engineer: Scale GPU Training & Inference

Reducto • San Francisco (CA)

On-site
USD 120,000 - 160,000
Unlimited PTO
Free lunch
Reimbursed transportation
+3
ML Infra Engineer - Scalable Training & Inference (Equity)
ML Infra Engineer - Scalable Training & Inference (Equity)

Snapchat • Palo Alto (CA)

On-site
USD 209,000 - 313,000
ML Infrastructure Engineer: Scale & Performance
ML Infrastructure Engineer: Scale & Performance

Physical Intelligence • San Francisco (CA)

On-site
USD 150,000 - 230,000