Software Engineer, Systems ML - Compilers / Backend

Meta; New York (NY); On-site; USD 154,000 - 217,000; Full time

Job summary

Meta Reality Labs is seeking a Software Engineer to help develop the compiler tool-chain for deep learning hardware accelerators in AR/VR systems. You will design and implement a clean slate compiler, optimize kernels, and collaborate with ML, firmware, and ASIC teams to map PyTorch models to custom hardware.

Join the Reality Labs Silicon team to push performance, power efficiency and programmability on next-generation on-device AI for immersive experiences in New York.

Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
• 2+ years experience developing compilers, toolchains, runtime, or similar code optimization software
• Experience in software design and programming experience in Python and/or C/C++ for development, debugging, testing and performance analysis
• Experience in AI framework development or accelerating models on hardware architectures (GPU, TPU, custom AI ASICs)

Responsibilities

• Analyze and design effective compiler passes and optimizations. Implement and/or enhance code generation targeting machine learning accelerators
• Work with algorithm research teams to map ML graphs to hardware implementations, model data-flows, create cost-benefit analysis and estimate silicon power and performance
• Work with hardware architects to co-design hardware features that maximize performance, power efficiency and programmability
• Contribute to the development of machine-learning libraries, intermediate representations, export formats, and analysis tools
• Analyze and improve the efficiency, scalability, and stability of our toolchains. Optimize and tune kernels and compiled code to achieve latency targets for ML inference
• Conduct design and code reviews. Evaluate code performance, debug, diagnose and drive resolution of compiler and cross-disciplinary system issues
• Interface with other compiler-focused teams to evaluate and incorporate their innovations and vice versa

Skills

Python

C/C++

Software design

Performance analysis

AI frameworks

Education

Bachelor's degree in Computer Science/Engineering or equivalent

Tools

LLVM

MLIR

GCC

MSVC

Glow

Job description

Summary:

Reality Labs (RL) focuses on delivering Meta's vision through Virtual Reality (VR), Augmented Reality (AR) and Wearable AI Devices. The compute performance and power efficiency requirements of our AI devices require custom silicon. Reality Labs Silicon team is driving the state of the art forward with breakthrough work in computer vision, machine learning, mixed reality, graphics, displays, sensors, and new ways to map the human body. Our chips will unlock personalized on-device AI capabilities and blend virtual, physical worlds on wearable devices. We believe the only way to achieve our goals is to look at the entire stack, from transistors, through architecture, firmware, and algorithms.We are seeking a software engineer to support the development of the compiler tool-chain for state-of-the-art deep learning hardware components optimized for AR/VR systems. You will be part of our efforts to architect, design and implement a clean slate compiler for this activity and will be part of a team that includes compiler, machine learning algorithms and software, firmware and ASIC experts. You will contribute to a full stack development effort compiling PyTorch models down to binaries for custom hardware accelerator blocks.

Required Skills:

Software Engineer, Systems ML - Compilers / Backend Responsibilities:

1. Analyze and design effective compiler passes and optimizations. Implement and/or enhance code generation targeting machine learning accelerators

2. Work with algorithm research teams to map ML graphs to hardware implementations, model data-flows, create cost-benefit analysis and estimate silicon power and performance

3. Work with hardware architects to co-design hardware features that maximize performance, power efficiency and programmability

4. Contribute to the development of machine-learning libraries, intermediate representations, export formats, and analysis tools

5. Analyze and improve the efficiency, scalability, and stability of our toolchains. Optimize and tune kernels and compiled code to achieve latency targets for ML inference

6. Conduct design and code reviews. Evaluate code performance, debug, diagnose and drive resolution of compiler and cross-disciplinary system issues

7. Interface with other compiler-focused teams to evaluate and incorporate their innovations and vice versa

Minimum Qualifications:

Minimum Qualifications:

1. Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience

2. 2+ years experience developing compilers, toolchains, runtime, or similar code optimization software

3. Experience in software design and programming experience in Python and/or C/C++ for development, debugging, testing and performance analysis

4. Experience in AI framework development or accelerating models on hardware architectures (GPU, TPU, custom AI ASICs)

Preferred Qualifications:

Preferred Qualifications:

1. Experience of developing in a mainstream machine-learning framework, e.g. PyTorch, MLIR, Tensorflow or Caffe

2. Experience with machine-code generation or compiler back-ends for on-device inference workloads

3. Experience working and communicating cross functionally in a team environment

4. Experience working on and contributing to an active compiler toolchain codebase, such as LLVM, MLIR, GCC, MSVC, Glow

5. Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologies

6. Experience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews)

7. Experience in deep learning algorithms and techniques, e.g., convolutional neural networks, recurrent networks, etc

8. Demonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements)

9. Experience developing high-performance kernels or runtime components and tuning them for inference specific accelerator platforms

Public Compensation:

$154,003/year to $217,000/year + bonus + equity + benefits

Industry:

Internet

Equal Opportunity:

Meta is proud to be an Equal Employment Opportunity and Affifi­ative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, trans­gender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.

Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at [e-mail].