Systems ML Engineer - High-Scale AI Infra (Equity)

Meta; Concord (NH); On-site; USD 154,000 - 217,000; Full time

Job summary

Meta is seeking a Software Engineer to join our Systems ML Engineering team. You will design and optimize ML infrastructure powering Meta’s products at massive scale, spanning model training, inference pipelines, and hardware-aware optimizations.

You will collaborate with researchers, platform engineers, and product teams to accelerate ML workloads, improve AI infrastructure efficiency, and drive reliable production systems serving billions of users.

Qualifications

• 6+ years of software engineering with a focus on ML systems.
• Experience building and optimizing ML training/inference pipelines.
• Experience with distributed computing architectures for ML workloads.
• Proficient in C++ and Python for performance-critical systems.
• Experience using profiling tools to identify bottlenecks.
• Experience with large-scale ML infrastructure and reliability.

Responsibilities

• Design and build large-scale ML training and inference systems.
• Develop high-performance ML infrastructure components in C++ and Python.
• Identify and resolve performance bottlenecks across the ML stack.
• Architect trade-offs in ML system design for efficiency.
• Partner with researchers and product teams to translate requirements.
• Define and track system-level metrics and SLIs for ML serving.
• Lead technical design reviews and establish engineering standards.
• Mentor engineers on infrastructure best practices and optimization.
• Drive AI-augmented development workflows to improve productivity.
• Contribute to staged rollout strategies with feature flags.

Skills

Large-scale ML systems

C++ and Python

Profiling & performance analysis

Distributed computing

ML infrastructure

Mentoring

Production reliability

Education

Bachelor's degree or equivalent practical experience

Tools

CUDA

ROCm

MLIR

LLVM

TVM

XLA

IREE

Job description

Meta is seeking a Software Engineer to join our Systems ML Engineering team. You will design and optimize ML infrastructure powering Meta’s products at massive scale, spanning model training, inference pipelines, and hardware-aware optimizations.

You will collaborate with researchers, platform engineers, and product teams to accelerate ML workloads, improve AI infrastructure efficiency, and drive reliable production systems serving billions of users.