Principal ML Systems Architect for Large-Scale Infra

Meta; Helena (MT); On-site; USD 219,000 - 301,000; Full time

Job summary

Meta is seeking a principal-level Software Engineer to shape the architectural foundations for large-scale ML infrastructure, spanning training, inference, compilers, and on-device optimization. You will define multi-year roadmaps and partner with research, hardware, and product teams to translate advances into production systems.

You will mentor engineers, drive cross-organizational initiatives, and communicate complex ML architectures clearly to diverse audiences.

Qualifications

• Bachelor's degree in CS, CE, or related field, or equivalent practical experience
• 12+ years of software engineering experience with deep ML systems focus
• Experience architecting large-scale ML training or inference infra with cross-team impact
• Experience leading multi-year cross-functional technical initiatives across org boundaries
• Experience developing high-performance ML systems in C++, Python, or CUDA
• Experience influencing technical direction through proposals and design reviews

Responsibilities

• Identify and solve the most complex cross-system ML infrastructure challenges spanning training, inference, compiler optimization, and hardware-software co-design
• Define extensible architectural standards and technical foundations for ML systems across multiple engineering organizations
• Develop and own the multi-year technical roadmap for ML systems infrastructure balancing short-term delivery with platform health
• Leverage AI-native tooling to reduce engineering toil and enable cross-disciplinary work
• Drive performance improvements across large-scale ML training and inference systems
• Establish invariants, correctness proofs, and reliability practices for ML pipelines
• Partner with research, hardware, and product teams to translate advances into production infrastructure
• Assess emerging AI technologies and influence strategy to maintain competitiveness
• Mentor engineers and foster a culture of high craft in ML systems
• Communicate complex ML architectures and roadmaps to technical and non-technical audiences

Skills

ML infrastructure

C++

Python

CUDA

GPU architecture

High-performance computing

ML frameworks

On-device optimization

Education

Bachelor's degree in Computer Science, Computer Engineering, or equivalent

Tools

MLIR

XLA

TVM

CUDA

Job description

Meta is seeking a principal-level Software Engineer to shape the architectural foundations for large-scale ML infrastructure, spanning training, inference, compilers, and on-device optimization. You will define multi-year roadmaps and partner with research, hardware, and product teams to translate advances into production systems.

You will mentor engineers, drive cross-organizational initiatives, and communicate complex ML architectures clearly to diverse audiences.