Lead Systems ML Engineer – High-Performance AI Infra

Meta; Sacramento (CA); On-site; USD 154,000 - 217,000; Full time

Benefits offered by this job

Bonus

Equity

Benefits

Job summary

Meta seeks a Software Engineer to join the Systems ML Engineering team, focusing on scalable ML infrastructure for training and serving at massive scale. You will design high-performance ML pipelines, optimize hardware-aware code, and collaborate with researchers and platform teams to accelerate workloads across a broad stack.

The role emphasizes profiling, distributed design, and production reliability, with opportunities to mentor peers and lead architecture reviews in a fast-evolving

Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, or equivalent practical experience.
• 6+ years of software engineering experience in ML systems, AI infrastructure, or high-performance computing.
• Experience with ML training or inference pipelines using PyTorch, TensorFlow, or equivalent.
• Experience with distributed computing and large-scale systems design for ML workloads.
• Proficiency in C++ and Python for performance-critical systems.
• Experience using profiling/analysis tools to optimize ML or compute-intensive systems.

Responsibilities

• Design, build, and optimize large-scale ML training/inference systems.
• Develop high-performance ML infrastructure components in C++ and Python.
• Identify and resolve performance bottlenecks across the ML stack.
• Architect and evaluate trade-offs in ML system design.
• Partner with researchers and product teams to translate ML requirements into infrastructure.
• Define and track system-level metrics and SLOs for ML serving systems.
• Lead technical design reviews and engineering standards for ML systems.
• Mentor engineers on ML infrastructure and performance optimization.
• Drive adoption of AI-augmented development workflows and feature flagged rollouts.

Skills

ML training pipelines

C++/Python performance

Profiling tools

Distributed systems

ML frameworks

GPU programming

MLIR/LLVM

AI ethics

Education

Bachelor's degree in CS/CE or equivalent

Tools

CUDA

TensorFlow/PyTorch

MLIR

LLVM

TVM/XLA/IREE

Job description

Meta seeks a Software Engineer to join the Systems ML Engineering team, focusing on scalable ML infrastructure for training and serving at massive scale. You will design high-performance ML pipelines, optimize hardware-aware code, and collaborate with researchers and platform teams to accelerate workloads across a broad stack.

The role emphasizes profiling, distributed design, and production reliability, with opportunities to mentor peers and lead architecture reviews in a fast-evolving