Principal Systems ML Engineer - Scalable AI Infra

Meta; Denver (CO); On-site; USD 219,000 - 301,000; Full time

Job summary

Meta is seeking a principal-level Software Engineer to drive technical strategy for Systems ML Engineering, shaping foundations for large-scale ML infrastructure including training, inference, and on-device optimization.

You will define multi-year roadmaps, partner across research, hardware, and product teams, and mentor engineers to raise the bar on engineering craftsmanship and reliability.

Qualifications

• Bachelor's degree or equivalent practical experience in CS/engineering.
• 12+ years of software engineering with deep ML systems specialization.
• Experience architecting and delivering large-scale ML training/inference infra.
• Experience leading multi-year cross-functional technical initiatives.
• Experience developing high-performance ML systems in C++, Python, or CUDA.
• Experience influencing technical direction across teams.

Responsibilities

• Identify and solve the most complex cross-system ML infrastructure challenges across training, inference, compilers, and hardware-software co-design.
• Define extensible architectural standards for ML systems.
• Develop and own multi-year technical roadmaps for ML infrastructure.
• Leverage AI-native tooling to reduce engineering toil and accelerate cross-disciplinary work.
• Drive performance improvements across large-scale ML systems.
• Establish reliability practices to prevent failures across ML pipelines.
• Collaborate with research, hardware, and product teams to productionize ML advances.
• Assess emerging AI technologies and influence organizational strategy.
• Mentor engineers and foster a culture of high craft in ML systems development.
• Communicate architecture and roadmap clearly to technical and non-technical audiences.

Skills

ML systems

Large-scale infra

C++/Python/CUDA

Cross-functional leadership

Communication

Mentoring

Education

Bachelor's degree in Computer Science, Computer Engineering, or equivalent

Tools

C++

Python

CUDA

Job description

Meta is seeking a principal-level Software Engineer to drive technical strategy for Systems ML Engineering, shaping foundations for large-scale ML infrastructure including training, inference, and on-device optimization.

You will define multi-year roadmaps, partner across research, hardware, and product teams, and mentor engineers to raise the bar on engineering craftsmanship and reliability.