Senior Systems ML Engineer — Scalable AI Infrastructure

Meta; Indianapolis (IN); On-site; USD 154,000 - 217,000; Full time

Job summary

Meta seeks a Software Engineer for the Systems ML Engineering team to build and optimize ML infrastructure at massive scale. You will design high-performance ML pipelines, spanning training, inference, and hardware-aware optimizations, collaborating across researchers, platform engineers, and product teams.

You will lead the design reviews, mentor engineers, and push for AI-augmented workflows to expand productivity while ensuring reliable ML serving systems.

Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, or equivalent practical experience.
• 6+ years of software engineering with focus on ML systems, AI infrastructure, or HPC.
• Experience with ML training/inference pipelines using PyTorch, TensorFlow, or equivalent.
• Experience with distributed computing architectures and large-scale ML systems.
• Experience in C++ and Python for performance-critical systems.
• Experience using profiling and performance analysis tools to identify bottlenecks.

Responsibilities

• Design, build, and optimize large-scale ML training and inference systems.
• Develop and maintain high-performance ML infrastructure components in C++ and Python.
• Identify and resolve performance bottlenecks across the ML stack using profiling tools.
• Architect and evaluate trade-offs in ML system design for memory and I/O throughput.
• Partner with research/product teams to translate model requirements into infrastructure.
• Define and track system-level metrics and SLIs to maintain production reliability.
• Lead design reviews and contribute to ML system engineering standards.
• Mentor engineers on ML infrastructure best practices and performance optimization.
• Drive AI-augmented development workflows to boost productivity and scope.
• Contribute to staged rollout strategies using feature flags and experimentation.

Skills

C++

Python

Profiling tools

Distributed systems

ML infrastructure

Education

Bachelor's degree in Computer Science or related

Tools

PyTorch

TensorFlow

CUDA

MLIR

LLVM

TVM

XLA

IREE

Job description

Meta seeks a Software Engineer for the Systems ML Engineering team to build and optimize ML infrastructure at massive scale. You will design high-performance ML pipelines, spanning training, inference, and hardware-aware optimizations, collaborating across researchers, platform engineers, and product teams.

You will lead the design reviews, mentor engineers, and push for AI-augmented workflows to expand productivity while ensuring reliable ML serving systems.