Software Engineer, Systems ML - Compilers / Kernels

Meta; Menlo Park (CA); On-site; USD 154,000 - 217,000; Full time

Job summary

Meta is seeking a Software Engineer to design, build, and optimize systems-level ML infrastructure that powers large AI workloads across production environments. You will work at the intersection of ML frameworks, distributed systems, and hardware acceleration to improve reliability, performance, and scalability of ML platforms powering Meta's AI-driven products.

You will collaborate with researchers and hardware teams, own system design, and contribute to tooling, testing, and incident response

Qualifications

• 6+ years of software engineering experience in systems software, ML infrastructure, or distributed computing.
• Experience designing and optimizing software systems for large-scale ML training or inference workloads.
• Experience with performance analysis and optimization including profiling and low-level tuning.
• Experience building reliable distributed systems with observability, monitoring, and incident response practices.
• Experience communicating technical decisions through design documents or architectural proposals.

Responsibilities

• Design and implement scalable systems-level software components for large-scale ML workloads across distributed compute infrastructure.
• Identify and resolve performance bottlenecks through profiling, instrumentation, and targeted optimization of compute, memory and I/O.
• Collaborate with AI researchers and hardware teams to map deep learning models onto accelerated hardware.
• Own the technical design of systems components, evaluating trade-offs across correctness, performance, reliability, and maintainability.
• Establish and monitor SLIs/SLAs; build dashboards and alerts to reduce MTTR during incidents; drive best-practices and code reviews.

Skills

Distributed computing

Performance profiling

Low-level systems tuning

Observability & monitoring

Code reviews

Education

Bachelor's degree in Computer Science or related field

Tools

MLIR

LLVM

TVM

XLA

CUDA

Job description

Meta is seeking a Software Engineer to work on systems-level machine learning infrastructure that powers some of the world's largest AI workloads. In this role, you will design, build, and optimize the software systems that enable efficient training and inference of large-scale deep learning models across Meta's production infrastructure. You will work at the intersection of ML frameworks, distributed systems, and hardware acceleration, contributing to the reliability, performance, and scalability of ML platforms that underpin Meta's AI-driven products across social media, augmented and virtual reality, and generative AI.Software Engineer, Systems ML - Compilers / Kernels Responsibilities:Design and implement scalable systems-level software components that support large-scale ML training and inference workloads across distributed compute infrastructureIdentify and resolve performance bottlenecks in ML pipelines through profiling, instrumentation, and targeted optimization of compute, memory, and I/O utilizationDevelop and maintain high-quality, well-tested software for ML runtime systems, including scheduling, resource management, and execution frameworksCollaborate with AI researchers and hardware teams to co-design software solutions that efficiently map deep learning model architectures onto accelerated hardware platformsOwn the technical design of systems components, evaluating trade-offs across correctness, performance, reliability, and maintainabilityEstablish and monitor service-level objectives and performance metrics for ML infrastructure systems, building dashboards and alerting to reduce mean time to mitigation during incidentsDrive adoption of engineering best practices including automated testing, staged rollout strategies using feature flagging and A/B testing frameworks, and comprehensive documentationMentor other engineers on the team by identifying growth areas, sharing technical expertise, and contributing to code and design reviewsPartner with cross-functional stakeholders including product, data science, and operations teams to translate ML research requirements into production-ready systemsProactively identify opportunities to improve developer tooling, automation, and engineering efficiency across the ML systems organizationMinimum Qualifications:Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience6+ years of experience in software engineering with a focus on systems software, ML infrastructure, or distributed computingExperience designing and optimizing software systems for large-scale machine learning training or inference workloadsExperience with performance analysis and optimization techniques including profiling, bottleneck identification, and low-level systems tuningExperience building reliable, production-grade distributed systems with well-defined observability, monitoring, and incident response practicesExperience communicating technical decisions through design documents, architectural proposals, or cross-functional stakeholder alignmentPreferred Qualifications:Experience with ML frameworks such as PyTorch, TensorFlow, or JAX, including framework internals, operator development, or runtime optimizationDemonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologiesDemonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements)Experience with compiler technologies or graph-level optimizations for deep learning, such as MLIR, LLVM, TVM, or XLAExperience with GPU or AI accelerator programming models such as CUDA, ROCm, or vendor-specific kernel librariesExperience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews)Experience applying responsible AI practices in systems design, including bias mitigation, model quality evaluation, or AI risk assessmentAbout Meta:Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today—beyond the constraints of screens, the limits of distance, and even the rules of physics.Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at [e-mail].$154,003/year to $217,000/year + bonus + equity + benefitsIndividual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about benefits at Meta.