ML Infra Engineer: Petabyte-Scale Training & Data Pipelines

Avala; San Francisco (CA); Hybrid; USD 170,000 - 250,000; Full time

Benefits offered by this job

Equity

Health insurance

Dental insurance

Vision insurance

FSA

Unlimited PTO

Job summary

Avala is seeking a senior ML infrastructure engineer in San Francisco to scale neural network training infrastructure for Physical AI data needs. You will optimize data loading, pipelines, and distributed training across massive GPU clusters.

Join a team building cutting-edge autonomous systems data infrastructure, with equity and comprehensive health benefits. Competitive salary commensurate with experience and impact.

Qualifications

• 4+ years experience in ML infrastructure and training systems.
• Deep expertise in PyTorch or TensorFlow internals.
• Strong understanding of distributed computing and GPU optimization.
• Experience with large-scale data processing (petabyte+)
• Proficiency in Python and C++ for performance-critical code.
• Knowledge of modern ML architectures (transformers, vision models).
• Experience optimizing memory usage and training throughput.

Responsibilities

• Design and implement high-performance neural network training infrastructure
• Optimize training and evaluation code for maximum efficiency
• Build data pipelines handling petabytes of autonomous vehicle and robotics data
• Develop profiling and debugging tools for ML training systems
• Implement distributed training across large GPU clusters
• Work with research teams to enable rapid experimentation at scale

Skills

ML infrastructure

PyTorch internals

TensorFlow internals

Distributed computing

GPU optimization

Python

C++

Transformers

Vision models

Job description

Avala is seeking a senior ML infrastructure engineer in San Francisco to scale neural network training infrastructure for Physical AI data needs. You will optimize data loading, pipelines, and distributed training across massive GPU clusters.

Join a team building cutting-edge autonomous systems data infrastructure, with equity and comprehensive health benefits. Competitive salary commensurate with experience and impact.