Software Engineer, Systems ML (Technical Leadership)

Meta Careers; New York (NY); On-site; USD 219,000 - 301,000; Full time

Job summary

Meta seeks a principal-level Software Engineer to drive technical strategy and execution across Systems ML Engineering. Define architectural foundations for large-scale ML infrastructure, spanning training systems, inference pipelines, and on-device optimization.

The role requires deep expertise in ML systems, C++, Python, CUDA, and collaboration across research, hardware, and product teams to deliver measurable efficiency gains.

Qualifications

• Bachelor's degree in CS/CE or related field.
• 12+ years of software engineering experience with deep specialization in ML systems.

Responsibilities

• Identify and solve complex cross-system ML infrastructure challenges across training, inference, and hardware-software co-design.
• Define extensible architectural standards for ML systems ensuring reliability across teams.
• Own multi-year technical roadmaps balancing short-term delivery with long-term platform health.

Skills

ML systems

AI infrastructure

C++

Python

CUDA

GPU architecture

Cross-functional leadership

Roadmap development

Education

Bachelor's degree in Computer Science or related field

Tools

MLIR

XLA

TVM

Job description

Meta is seeking a principal-level Software Engineer to drive technical strategy and execution across our Systems ML Engineering organization. In this role, you will define the architectural foundations that power large-scale machine learning infrastructure, spanning training systems, inference pipelines, ML compilers, high-performance computing frameworks, and on-device optimization. You will identify and solve the hardest cross-system ML infrastructure challenges, shape multi-year technical roadmaps, and amplify the impact of engineering teams through AI-native workflows and deep systems expertise. This is a role for engineers who identify problems others miss and drive them to resolution at organizational scale.Software Engineer, Systems ML (Technical Leadership) Responsibilities:Identify and solve the most complex cross-system ML infrastructure challenges spanning training, inference, compiler optimization, and hardware-software co-design, including problems that have resisted prior solution attemptsDefine extensible architectural standards and technical foundations for ML systems that enable consistency and reliability across multiple engineering organizationsDevelop and own the multi-year technical roadmap for ML systems infrastructure, balancing short-term delivery with long-term platform health and competitive positioningLeverage AI-native tooling and workflows as a force multiplier to eliminate entire categories of engineering toil and accelerate cross-disciplinary work across the ML systems stackDrive performance improvements across large-scale ML training and inference systems by identifying bottlenecks that span multiple subsystems, ownership boundaries, and abstraction layersEstablish invariants, correctness proofs, and systemic reliability practices that prevent whole classes of failures across ML infrastructure pipelinesPartner with research, hardware, and product engineering teams to translate theoretical ML systems advances into production infrastructure that delivers measurable efficiency and capability gainsAssess emerging AI and computing technologies, evaluate competitive ML infrastructure trends, and influence organizational strategy to ensure technical competitivenessMentor engineers across the organization by providing customized coaching, leading engineering programs, and establishing a culture of thoroughness and high craft in ML systems developmentCommunicate complex ML systems architecture and strategy clearly to technical and non-technical audiences, producing reference-quality design documents and roadmap artifactsMinimum Qualifications:Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience12+ years of experience in software engineering with deep specialization in one or more ML systems domains including AI infrastructure, ML compilers, high-performance computing, GPU architecture, ML frameworks, or on-device optimizationExperience architecting and delivering large-scale ML training or inference infrastructure that has had measurable impact across multiple engineering organizationsExperience leading multi-year cross-functional technical initiatives, including defining metrics, managing dependencies, and driving execution across organizational boundariesExperience developing high-performance ML systems infrastructure in C++, Python, or CUDA, including work at the intersection of hardware and softwareExperience influencing technical direction and engineering practices across multiple teams through written proposals, design reviews, and stakeholder alignmentPreferred Qualifications:Demonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements)Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologiesExperience contributing to industry-wide ML systems efforts through publications, open-source projects, or standards bodiesExperience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews)Track record of applying AI tools and automation to redesign engineering workflows, with demonstrated efficiency or quality improvements at organizational scaleExperience with ML compiler stacks such as MLIR, XLA, or TVM, or with hardware-software co-design for custom ML acceleratorsExperience defining and operationalizing reliability, performance, and correctness standards for distributed ML training or large-scale inference systemsAbout Meta:Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today—beyond the constraints of screens, the limits of distance, and even the rules of physics.Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at [e-mail].$219,000/year to $301,000/year + bonus + equity + benefitsIndividual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about benefits at Meta.