ML Platform SRE — Scale AI Ops for Ads (AWS/K8s)

Apple, Inc.; New York (NY); On-site; USD 150,000 - 225,000; Full time

Benefits offered by this job

Medical and dental coverage

Employee stock programs

Relocation assistance

Tuition reimbursement

Discretionary bonuses

Job summary

Apple Inc. in New York City is seeking a Site Reliability Engineer focused on ML to own the health, performance, and scalability of large-scale ML infrastructure powering Apple Ads. You will build automation to reduce manual toil and boost platform resilience.

The role involves partnering with Ads, data science, and ML platform teams, deploying via Terraform, and operating across AWS environments. A strong ML lifecycle background is essential.

Qualifications

• 3+ years in internet-facing backend production systems, SRE or ML Operations focused roles on large scale distributed cloud infrastructure.
• Proven expertise with AWS-managed infrastructure
• Familiarity with ML lifecycle and associated technologies such as NVIDIA Triton, AnyScale Ray, Apache Airflow etc.
• Strong programming skills in Python, Java, Rust, Go or similar languages
• Hands-on experience with Linux systems and deep knowledge of its internals.
• Demonstrated experience with Infrastructure as Code, especially Terraform.
• Strong foundation in SRE concepts: Monitoring, alerting, observability, Incident response and root cause analysis, Error budgets, SLAs/SLOs, and system reliability

Responsibilities

• Build and operate distributed systems using AWS managed services such as EKS, ElasticCache and ML technologies like Ray over Kubernetes and NVIDIA Triton Inference Server.
• Develop internal tooling and automation frameworks to improve infrastructure reliability, cost-efficiency, and operational visibility.
• Collaborate with engineering teams to define infrastructure architecture, troubleshoot complex issues, and drive production excellence.
• Design and manage Infrastructure as Code with Terraform, ensuring repeatable, secure, and scalable deployments.
• Lead or participate in incident response, postmortems, and continuous improvement cycles to reduce future risk.

Skills

AWS

Kubernetes

Terraform

Python

Java

Go

Linux

Ray

NVIDIA Triton

Apache Airflow

Monitoring/Observability

SRE fundamentals

Tools

Terraform

Ray

NVIDIA Triton

Apache Airflow

EKS

Job description

Apple Inc. in New York City is seeking a Site Reliability Engineer focused on ML to own the health, performance, and scalability of large-scale ML infrastructure powering Apple Ads. You will build automation to reduce manual toil and boost platform resilience.

The role involves partnering with Ads, data science, and ML platform teams, deploying via Terraform, and operating across AWS environments. A strong ML lifecycle background is essential.