Senior Distinguished Engineer - Foundation Model Inference

Apple Inc.; Cupertino (CA); On-site; USD 311,000 - 497,000; Full time

Job summary

Apple seeks a Distinguished Engineer in Cupertino to set the technical direction for our foundation model inference engine. This senior individual‑contributor role partners with ML researchers to define the vision and drive delivery across multiple teams, enabling training, evaluation, and large‑scale inference workloads on Apple silicon.

You will mentor engineers, shape architecture across training and data systems, and translate diverse needs into a coherent platform.

Qualifications

• MS or PhD in CS/ML or equivalent.
• 15+ years building large-scale ML or distributed systems.
• Deep expertise in foundation model inference engines.
• Experience leading diverse engineering teams.
• Experience partnering with ML researchers and modeling teams.

Responsibilities

• Set and drive the technical vision for the foundation model inference engine.
• Lead performance, efficiency, and reliability improvements.
• Architect inference systems for training, evaluation, and judge workloads.
• Collaborate with ML researchers to co-design models and systems.
• Mentor engineers and define engineering standards.

Skills

Foundation model inference engines

GPU/TPU/accelerator architecture

Distributed systems

JAX

PyTorch

Quantization

Distillation

Compilation

Serving

Education

MS or PhD in Computer Science, Machine Learning, or related field

Tools

Kubernetes

Docker

AWS

GCP

Azure

Job description

Apple seeks a Distinguished Engineer in Cupertino to set the technical direction for our foundation model inference engine. This senior individual‑contributor role partners with ML researchers to define the vision and drive delivery across multiple teams, enabling training, evaluation, and large‑scale inference workloads on Apple silicon.

You will mentor engineers, shape architecture across training and data systems, and translate diverse needs into a coherent platform.