Senior ML Engineer, Foundation Model Inference (Cloud OS)

Apple Inc.; Seattle (WA); On-site; USD 185,000 - 325,000; Full time

Job summary

Apple Inc. seeks a Sr. Machine Learning Engineer for Foundation Models Inference in Cloud OS & Inference to advance private, scalable AI inference across Siri, Apple Intelligence, and app ecosystems.

You will bridge research and production, optimizing inference, hardware/software codesign, and system architectures at planetary scale. You will own high-throughput, low-latency serving, mentor engineers, and collaborate with security teams to ensure performance and trust at scale.

Qualifications

• 5+ years leading complex, ambiguous technical projects end-to-end.
• Hands-on experience with LLM inference stacks.
• Working knowledge of GPU or TPU programming concepts.
• Proficiency with PyTorch, JAX, or TensorFlow.
• Experience building and operating high-throughput services at large distributed scale.
• Proficiency deploying applications on cloud platforms (AWS, GCP, or equivalent) using Kubernetes and Docker.
• BS in Computer Science, Machine Learning, Artificial Intelligence, Data Science, or a related field.

Responsibilities

• Partner with the Foundation Model Research team and external partners to optimize inference for the latest model architectures across language, vision, and speech.
• Design and ship production-grade inference systems serving millions of customers in real time.
• Build profiling tools and simulators to identify and resolve performance bottlenecks across different hardware configurations and use cases.
• Drive technical decisions on high-throughput, low-latency serving at supercomputing scale.
• Mentor and grow engineers across the organization.

Skills

LLM inference stacks

GPU/TPU programming

PyTorch

JAX

TensorFlow

Distributed systems

Kubernetes

Docker

Cloud platforms (AWS, GCP)

Education

BS in Computer Science, ML, AI or related field

MS in Computer Science, ML, AI or related field

Tools

CUDA

CUDA C++

OpenAI Triton

Nvidia Triton Server

TensorRT-LLM

vLLM

TGI

Job description

Apple Inc. seeks a Sr. Machine Learning Engineer for Foundation Models Inference in Cloud OS & Inference to advance private, scalable AI inference across Siri, Apple Intelligence, and app ecosystems.

You will bridge research and production, optimizing inference, hardware/software codesign, and system architectures at planetary scale. You will own high-throughput, low-latency serving, mentor engineers, and collaborate with security teams to ensure performance and trust at scale.