Software Engineer, Systems ML

Meta; Madison (WI); On-site; USD 154,000 - 217,000; Full time

Job summary

Meta is seeking a Software Engineer for the Systems ML Engineering team in Madison, WI. You will design and optimize ML infrastructure spanning training, inference, and hardware-aware pipelines, collaborating with researchers and product teams to scale AI workloads serving billions of users.

You will implement high-performance components in C++ and Python, identify bottlenecks, and contribute to system design decisions while mentoring others on best practices for ML infrastructure.

Qualifications

• Bachelor's degree in CS/CE or equivalent practical experience.
• 6+ years in software engineering focused on ML systems or AI infrastructure.
• Experience with PyTorch, TensorFlow, or equivalent.
• Experience in distributed architectures for ML workloads.
• Proficiency in C++ and Python for performance-critical systems.
• Experience with profiling to identify bottlenecks.

Responsibilities

• Design, build, and optimize large-scale ML training and inference systems.
• Develop high-performance ML infrastructure components in C++ and Python.
• Identify and resolve performance bottlenecks across the ML stack.
• Architect trade-offs in ML system design for memory, compute, I/O.
• Collaborate with research and product teams to translate model needs into infra.
• Define system-level metrics and SLA for production ML serving.
• Lead design reviews and engineering standards for ML systems.
• Mentor engineers on ML infra and performance optimization.
• Drive AI-augmented development workflows to boost productivity.

Skills

Large-scale ML systems

C++

Python

Performance optimization

Profiling tools

Distributed computing

ML frameworks

System design

Hardware-aware optimization

Mentoring

Education

Bachelor's degree in Computer Science or related

Tools

CUDA

ROCm

MLIR

LLVM

XLA

Job description

Summary:

Meta is seeking a Software Engineer to join our Systems ML Engineering team, focused on building and optimizing the machine learning infrastructure that powers Meta's products at massive scale. In this role, you will design and develop high-performance ML systems, working across the full stack from model training and inference pipelines to hardware-aware optimizations. You will collaborate with researchers, platform engineers, and product teams to accelerate ML workloads and improve the efficiency of AI infrastructure that serves billions of users.

Required Skills:

Software Engineer, Systems ML Responsibilities:

1. Design, build, and optimize large-scale ML training and inference systems, including distributed computing frameworks and hardware-accelerated pipelines

2. Develop and maintain high-performance ML infrastructure components in C++ and Python, ensuring reliability, scalability, and low-latency execution

3. Identify and resolve performance bottlenecks across the ML stack using profiling, instrumentation, and benchmarking tools

4. Architect and evaluate trade-offs in ML system design, including memory bandwidth, compute utilization, and I/O throughput

5. Partner with research and product teams to translate ML model requirements into efficient infrastructure solutions

6. Define and track system‑level metrics and service level objectives to maintain production reliability of ML serving systems

7. Lead technical design reviews and contribute to engineering standards for ML systems across the organization

8. Mentor other engineers on ML infrastructure best practices, debugging methodologies, and performance optimization techniques

9. Drive adoption of AI‑augmented development workflows to expand engineering productivity and broaden the scope of deliverables

10. Contribute to staged rollout strategies using feature flagging and experimentation frameworks to safely deploy ML system changes

Minimum Qualifications:

Minimum Qualifications:

1. Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience

2. 6+ years of experience in software engineering with a focus on machine learning systems, AI infrastructure, or high‑performance computing

3. Experience developing and optimizing ML training or inference pipelines using frameworks such as PyTorch, TensorFlow, or equivalent

4. Experience with distributed computing architectures and large‑scale systems design for ML workloads

5. Experience programming in C++ and Python for performance‑critical systems

6. Experience using profiling and performance analysis tools to identify and resolve bottlenecks in ML or compute‑intensive systems

Preferred Qualifications:

Preferred Qualifications:

1. Experience optimizing large‑scale ranking and recommendation model inference on AI accelerator hardware

2. Experience with hardware‑software co‑design, including numerics optimization and SIMD or vectorization techniques

3. Demonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements)

4. Experience with GPU programming using CUDA, ROCm, or equivalent hardware accelerator kernel development

5. Experience with ML compiler technologies such as MLIR, LLVM, TVM, XLA, or IREE

6. Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologies

7. Experience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews)

Public Compensation:

$154,003/year to $217,000/year + bonus + equity + benefits

Industry:

Internet

Equal Opportunity:

Meta is proud to be an Equal Employment Opportunity and Aff ... We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.

Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at [e-mail].