Principal Systems ML Engineer – AI Infra & HPC

Meta; Redmond; On-site; AUD 312,000 - 428,000; Full time

Job summary

Meta is seeking a principal-level Software Engineer to drive technical strategy and execution across Systems ML Engineering. You will define architectural foundations for large-scale ML infrastructure spanning training, inference, compilers, and on-device optimization.

You will shape multi-year roadmaps, mentor engineers, and collaborate with research, hardware, and product teams to deliver measurable efficiency and capability gains across the organization.

Qualifications

• Bachelor's degree in CS/CE or equivalent practical experience.
• 12+ years of software engineering with ML systems focus.
• Experience delivering large-scale ML training/inference infra across orgs.
• Experience leading multi-year cross-functional initiatives.
• Experience developing high-performance ML systems in C++, Python, or CUDA.
• Experience influencing technical direction across teams.

Responsibilities

• Identify and solve the most complex cross-system ML infrastructure challenges spanning training, inference, compiler optimization, and hardware-software co-design.
• Define extensible architectural standards and technical foundations for ML systems across engineering organizations.
• Develop and own the multi-year technical roadmap for ML systems infrastructure.
• Leverage AI-native tooling to reduce engineering toil and accelerate cross-disciplinary work.
• Drive performance improvements across large-scale ML training and inference systems.
• Establish reliability practices to prevent ML infra failures across pipelines.
• Partner with research, hardware, and product teams to translate ML advances into production infrastructure.
• Assess emerging AI technologies and influence organizational strategy to stay competitive.
• Mentor engineers and foster a culture of high craft in ML systems development.
• Communicate architecture and strategy clearly to both technical and non-technical audiences.

Skills

ML systems

Architectural design

Roadmap planning

Mentoring engineers

Cross-functional collaboration

C++/Python/CUDA

Education

Bachelor's degree in CS/CE or equivalent

Tools

MLIR

XLA

TVM

GPU programming

Job description

Meta is seeking a principal-level Software Engineer to drive technical strategy and execution across Systems ML Engineering. You will define architectural foundations for large-scale ML infrastructure spanning training, inference, compilers, and on-device optimization.

You will shape multi-year roadmaps, mentor engineers, and collaborate with research, hardware, and product teams to deliver measurable efficiency and capability gains across the organization.