Principal Systems ML Engineer — Architect ML Infrastructure

Meta Careers; New York (NY); On-site; USD 219,000 - 301,000; Full time

Job summary

Meta seeks a principal-level Software Engineer to drive technical strategy and execution across Systems ML Engineering. Define architectural foundations for large-scale ML infrastructure, spanning training systems, inference pipelines, and on-device optimization.

The role requires deep expertise in ML systems, C++, Python, CUDA, and collaboration across research, hardware, and product teams to deliver measurable efficiency gains.

Qualifications

• Bachelor's degree in CS/CE or related field.
• 12+ years of software engineering experience with deep specialization in ML systems.

Responsibilities

• Identify and solve complex cross-system ML infrastructure challenges across training, inference, and hardware-software co-design.
• Define extensible architectural standards for ML systems ensuring reliability across teams.
• Own multi-year technical roadmaps balancing short-term delivery with long-term platform health.

Skills

ML systems

AI infrastructure

C++

Python

CUDA

GPU architecture

Cross-functional leadership

Roadmap development

Education

Bachelor's degree in Computer Science or related field

Tools

MLIR

XLA

TVM

Job description

Meta seeks a principal-level Software Engineer to drive technical strategy and execution across Systems ML Engineering. Define architectural foundations for large-scale ML infrastructure, spanning training systems, inference pipelines, and on-device optimization.

The role requires deep expertise in ML systems, C++, Python, CUDA, and collaboration across research, hardware, and product teams to deliver measurable efficiency gains.