Senior Machine Learning Engineer, Ads ML Efficiency

OpenKrill; United States; Remote; USD 217,000 - 303,000; Full time

Benefits offered by this job

Global Benefits

Family Planning

Mental Health & Coaching

Pension with employer match

Private Medical & Dental

Bike to Work

Flexible Vacation & Volunteer Time Off

Parental Leave

Job summary

Reddit is hiring an experienced ML Performance Engineer in the US to optimize production ML workloads end-to-end. You’ll profile bottlenecks across model execution, runtimes, and infrastructure, and implement measurable improvements.

Join the Ads ML Efficiency team to push latency down, improve throughput, and reduce costs while maintaining model quality. You’ll mentor engineers and build benchmarks for scalable, safe optimizations.

Qualifications

• Hands-on ML performance engineering experience in production or production-relevant workloads.
• Deep expertise in one ML performance area (inference, runtimes, DSP/compilers, GPU kernels, memory).
• Strong profiling and benchmarking skills with reliable baselines.
• Solid software engineering fundamentals in Python and systems programming.
• Understanding of production ML frameworks and hardware/trade-offs.

Responsibilities

• Own end-to-end performance optimization initiatives for high-impact production ML workloads.
• Profile and diagnose ML performance bottlenecks across model execution, frameworks, runtimes, memory, CPU/GPU utilization, and infrastructure.
• Design and implement performance improvements in inference execution, memory management, precision, compilers, or kernels.
• Improve ML training and serving efficiency, latency, throughput, and cost while maintaining model quality.
• Support faster model launches through benchmarking, load testing, regression detection, and launch-readiness improvements.
• Partner with model engineers and platform teams to identify high-leverage opportunities and validate end-to-end impact.
• Build reusable performance capabilities, benchmarks, tooling, and guidance for future model development.
• Mentor engineers through collaboration, code reviews, and performance debugging.

Skills

ML performance engineering

Profiling & benchmarking

Python & systems programming

ML systems understanding

Production engineering judgment

Communication skills

Tools

PyTorch

Dynamo

Inductor

TorchScript

TensorRT

CUDA

Job description

Reddit is a community of communities. It’s built on shared interests, passion, and trust, and is home to the most open and authentic conversations on the internet. Every day, Reddit users submit, vote, and comment on the topics they care most about. With 100,000+ active communities and approximately 130 million daily active unique visitors, Reddit is one of the internet’s largest sources of information. For more information, visit www.redditinc.com.

Location

Reddit has a flexible first workforce. Don't live near our office? No worries: you can work remotely from anywhere in the US or Canada.

About the Team

Reddit's Ads ML Efficiency team is focused on making machine learning workloads faster, more scalable, and more cost-efficient, enabling our Ads ML teams to develop, launch, and scale increasingly sophisticated models.

This role sits at the intersection of ML workloads, execution systems, and engineering leverage. The engineer will partner closely with ranking teams, serving owners, and ML Platform to identify important bottlenecks, implement targeted improvements, and connect execution and systems improvements to measurable end-to-end outcomes.

What you’ll do

• Own end-to-end performance optimization initiatives for high-impact production ML workloads, from bottleneck identification and implementation through validation and production rollout.
• Profile and diagnose ML performance bottlenecks across model execution, frameworks, runtimes, memory, CPU/GPU utilization, and infrastructure using rigorous benchmarking and measurement.
• Design and implement performance improvements involving inference execution, runtime behavior, batching, memory management, precision, compiler integration, custom operators, kernels, or other relevant techniques.
• Improve ML training and serving efficiency and scalability, optimizing latency, throughput, hardware utilization, and cost while maintaining model quality and production reliability.
• Support faster and safer model launches through performance benchmarking, load testing, regression detection, and launch-readiness improvements.
• Partner with model engineers and platform teams to identify high-leverage opportunities, integrate optimizations safely, and validate measurable end-to-end impact.
• Build reusable performance capabilities, including benchmarks, tooling, optimization patterns, and engineering guidance that accelerate future model development and deployment.
• Contribute to technical direction and mentor engineers through hands-on collaboration, code reviews, performance debugging, and knowledge sharing.

What we’re looking for

• Hands-on ML performance engineering experience: Demonstrated ability to diagnose and implement meaningful performance improvements in production or production-relevant ML workloads.
• Deep expertise in at least one ML performance area, such as inference execution, ML runtimes, compiler integration, GPU/kernel optimization, memory systems, or training execution.
• Strong profiling and benchmarking skills: Ability to identify bottlenecks systematically, establish reliable baselines, and validate measurable end-to-end improvements.
• Strong software engineering fundamentals: Experience implementing, debugging, testing, and maintaining performance-sensitive systems, with proficiency in Python and relevant systems programming technologies.
• ML systems understanding: Familiarity with production ML frameworks and the performance trade-offs across model execution, runtime, memory, hardware, and infrastructure.
• Production engineering judgment: Ability to balance performance improvements with numerical correctness, model quality, reliability, maintainability, and safe rollout.
• Good customer and platform instincts: can solve concrete bottlenecks while keeping maintainability, adoption, and future reuse in mind.
• Strong communication: able to explain tradeoffs clearly to engineers and partner teams.

Nice-to-have

• Experience optimizing large-scale inference or training workloads, particularly in recommendation systems, ranking, search, or retrieval.
• Experience with PyTorch, including performance optimization using technologies such as Dynamo, Inductor, AOTI, torch.export, or custom operators.
• Experience with inference runtimes, GPU execution, or performance technologies such as TensorRT, ONNX Runtime, CUDA, Triton, LLVM/MLIR, or equivalent systems.
• Experience with hardware-aware optimization, including batching, memory management, operator fusion, mixed precision, quantization, or accelerator efficiency.
• Experience with distributed-training performance, including GPU utilization, communication, data loading, memory efficiency, or training step-time optimization.
• Experience building performance benchmarks, profiling tools, regression detection, launch-readiness capabilities, or cost observability toolings for ML workloads.
• Experience working across ML modeling, serving, and platform infrastructure teams.

Specialized compiler internals or custom CUDA/Triton kernel development are valuable but not required. We value demonstrated performance engineering depth, sound technical judgment, and measurable workload impact over familiarity with any particular tool or framework.

Benefits

• Global Benefit programs that fit your lifestyle, from workspace to professional development to caregiving support
• Family Planning Support
• Gender-Affirming Care
• Mental Health & Coaching Benefits
• Group Personal Pension Scheme with Employer match
• Private Medical and Dental Scheme
• Income Replacement Programs
• Bike to Work scheme
• Flexible Vacation & Paid Volunteer Time Off
• Generous Paid Parental Leave

Pay Transparency

This job posting may span more than one career level.

In addition to base salary, this job is eligible to receive equity in the form of restricted stock units, and depending on the position offered, it may also be eligible to receive a commission. Additionally, Reddit offers a wide range of benefits to U.S.-based employees, including medical, dental, and vision insurance, 401(k) program with employer match, generous time off for vacation, and parental leave. To learn more, please visit https://www.redditinc.com/careers/.

To provide greater transparency to candidates, we share base salary ranges for all US-based job postings regardless of state. We set standard base pay ranges for all roles based on function, level, and country location, benchmarked against similar stage growth companies. Final offer amounts are determined by multiple factors including, skills, depth of work experience and relevant licenses/credentials, and may vary from the amounts listed below.

The base salary range for this position is:$216,700-$303,400 USD

In select roles and locations, the interviews will be recorded, transcribed and summarized by artificial intelligence (AI). You will have the opportunity to opt out of recording, transcription and summarization prior to any scheduled interviews.

During the interview, we will collect the following categories of personal information: Identifiers, Professional and Employment-Related Information, Sensory Information (audio/video recording), and any other categories of personal information you choose to share with us. We will use this information to evaluate your application for employment or an independent contractor role, as applicable. We will not sell your personal information or disclose it to any third party for their marketing purposes. We will delete any recording of your interview promptly after making a hiring decision. For more information about how we will handle your personal information, including our retention of it, please refer to our Candidate Privacy Policy for Potential Employees and Contractors.

Reddit is proud to be an equal opportunity employer, and is committed to building a workforce representative of the diverse communities we serve. Reddit is committed to providing reasonab