Senior Systems ML Engineer — High-Performance AI Infra

Meta; Annapolis (MD); On-site; USD 154,000 - 217,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

Meta is seeking a Software Engineer to join the Systems ML Engineering team, building ML infrastructure for scalable AI workloads. You will design high-performance ML systems and pipelines spanning training, inference, and hardware-aware optimizations.

Collaborate with researchers, platform engineers, and product teams to accelerate ML workloads serving billions of users. You will mentor engineers, lead technical design reviews, and drive adoption of AI-augmented workflows, with a strong

Qualifications

• Bachelor's degree in CS/CE or equivalent practical experience.
• 6+ years in software engineering focusing on ML systems or AI infrastructure.
• Experience with PyTorch/TensorFlow for training or inference pipelines.
• Experience with distributed architectures for ML workloads.
• Proficiency in C++ and Python for performance-critical systems.
• Experience with profiling and performance analysis tools.

Responsibilities

• Design, build, and optimize large-scale ML training and inference systems.
• Develop high-performance ML infrastructure components in C++ and Python.
• Identify and resolve performance bottlenecks across the ML stack.
• Architect trade-offs in ML system design including memory, compute, and I/O.
• Partner with research and product teams to translate model requirements.
• Define and track system-level metrics and SLOs for ML serving systems.
• Lead technical design reviews and contribute to engineering standards.
• Mentor engineers on ML infrastructure and performance optimization.
• Drive AI-augmented development workflows to boost productivity.
• Contribute to staged rollout strategies with feature flags.

Skills

Large-scale ML systems design

C++

Python

Distributed computing

Profiling & optimization

Education

Bachelor's in Computer Science/Engineering or equivalent

Tools

CUDA

ROCm

MLIR

LLVM

PyTorch

TensorFlow

Job description

Meta is seeking a Software Engineer to join the Systems ML Engineering team, building ML infrastructure for scalable AI workloads. You will design high-performance ML systems and pipelines spanning training, inference, and hardware-aware optimizations.

Collaborate with researchers, platform engineers, and product teams to accelerate ML workloads serving billions of users. You will mentor engineers, lead technical design reviews, and drive adoption of AI-augmented workflows, with a strong