ML Systems Engineer — Scalable AI Infrastructure

Meta; Columbus (OH); On-site; USD 154,000 - 217,000; Full time

Job summary

Meta is seeking a Software Engineer to join the Systems ML Engineering team in Columbus, OH. You will design and build high-performance ML infrastructure spanning training to inference, working across the full stack from pipelines to hardware-aware optimizations.

You will collaborate with researchers, platform engineers, and product teams to accelerate ML workloads, improve efficiency, and ensure reliable production ML serving at scale.

Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, or equivalent practical experience.
• 6+ years of software engineering with ML systems, AI infrastructure, or HPC.
• Experience with ML training/inference pipelines in PyTorch/TensorFlow or equivalent.
• Experience with distributed computing architectures for ML workloads.
• Proficiency in C++ and Python for performance-critical systems.
• Experience using profiling tools to identify and resolve bottlenecks.

Responsibilities

• Design, build, and optimize large-scale ML training and inference systems, including distributed frameworks and hardware-accelerated pipelines.
• Develop and maintain high-performance ML infrastructure components in C++ and Python.
• Identify and resolve performance bottlenecks across the ML stack using profiling, instrumentation, and benchmarking tools.
• Architect and evaluate trade-offs in ML system design, including memory bandwidth, compute utilization, and I/O throughput.
• Partner with research and product teams to translate ML model requirements into efficient infrastructure solutions.
• Define and track system-level metrics and service level objectives for ML serving systems.
• Lead technical design reviews and contribute to ML engineering standards.
• Mentor engineers on ML infrastructure best practices and performance optimization.

Skills

ML systems design

Performance optimization

Profiling & benchmarking

Distributed computing

Education

Bachelor's degree in CS/CE or equivalent

Tools

C++

Python

CUDA

PyTorch/TensorFlow

Job description

Meta is seeking a Software Engineer to join the Systems ML Engineering team in Columbus, OH. You will design and build high-performance ML infrastructure spanning training to inference, working across the full stack from pipelines to hardware-aware optimizations.

You will collaborate with researchers, platform engineers, and product teams to accelerate ML workloads, improve efficiency, and ensure reliable production ML serving at scale.