Senior Systems ML Engineer - High-Performance AI Infra

Meta; Jefferson City (MO); On-site; USD 154,000 - 217,000; Full time

Job summary

Meta is seeking a Software Engineer to join the Systems ML Engineering team, building and optimizing ML infrastructure at massive scale. You will design and develop high-performance ML systems across the full stack, from training pipelines to hardware-aware optimizations.

You will collaborate with researchers, platform engineers, and product teams to accelerate ML workloads and improve AI infrastructure serving billions of users.

Qualifications

• 6+ years in software engineering focusing on ML systems or high-performance computing.
• Experience building ML training or inference pipelines with PyTorch or TensorFlow.
• Experience with distributed architectures for ML workloads.
• Proficiency in C++ and Python for performance-critical systems.
• Experience using profiling tools to identify bottlenecks.

Responsibilities

• Design, build, and optimize large-scale ML training and inference systems.
• Develop and maintain high-performance ML infrastructure components in C++ and Python.
• Identify performance bottlenecks using profiling and benchmarking tools.
• Architect trade-offs in ML system design including memory bandwidth, compute utilization, and I/O throughput.
• Collaborate with research and product teams to translate model requirements into infrastructure solutions.
• Define system-level metrics and SLIs to maintain production reliability.

Skills

ML systems

C++

Python

Distributed systems

Profiling tools

PyTorch

TensorFlow

Tools

CUDA

ROCm

MLIR

LLVM

TVM

XLA

IREE

Job description

Meta is seeking a Software Engineer to join the Systems ML Engineering team, building and optimizing ML infrastructure at massive scale. You will design and develop high-performance ML systems across the full stack, from training pipelines to hardware-aware optimizations.

You will collaborate with researchers, platform engineers, and product teams to accelerate ML workloads and improve AI infrastructure serving billions of users.