Senior ML Engineer - Foundation Model Inference at Scale

Apple Inc.; Paris; On-site; EUR 120,000 - 190,000; Full time

Job summary

Apple Inc. is seeking a Senior Machine Learning Engineer for Foundation Models Inference within Cloud OS and AI Inference. You will own end-to-end inference efficiency, hardware/software codesign, and systems architecture to deliver high-performance, privacy-preserving AI workloads at scale.

You will collaborate with Foundation Model Research and external partners, build production-grade inference systems, and mentor engineers across the organisation.

Qualifications

• Experience leading complex ambiguous ML projects end-to-end.
• Proficiency in PyTorch or JAX.
• Experience working with inference frameworks.
• Experience in Python / Go / Rust.
• Experience deploying applications on cloud platforms (AWS, GCP or equivalent) using Kubernetes and Docker.

Responsibilities

• Partner with Foundation Model Research to optimise inference for latest model architectures across language, vision, and speech.
• Design and ship production-grade inference systems serving millions of customers in real time.
• Build profiling tools and simulators to identify performance bottlenecks across hardware configurations.
• Drive technical decisions on high-throughput, low-latency serving at scale.
• Mentor and grow engineers across the organisation.

Skills

Python

PyTorch

JAX

LLM inference

System design

Go/Rust

Education

MS in Computer Science / ML / AI

Tools

Docker

Kubernetes

TensorRT-LLM

NVIDIA Triton

vLLM

TGI

Job description

Apple Inc. is seeking a Senior Machine Learning Engineer for Foundation Models Inference within Cloud OS and AI Inference. You will own end-to-end inference efficiency, hardware/software codesign, and systems architecture to deliver high-performance, privacy-preserving AI workloads at scale.

You will collaborate with Foundation Model Research and external partners, build production-grade inference systems, and mentor engineers across the organisation.