Senior Distinguished Engineer - Foundation Model Inference

Apple

Cupertino (CA)

On-site

USD 311,000 - 497,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Apple seeks a Distinguished Engineer in Cupertino to set the technical direction for our foundation model inference engine. This senior individual‑contributor role partners with ML researchers to define the vision and drive delivery across multiple teams, enabling training, evaluation, and large‑scale inference workloads on Apple silicon.

You will mentor engineers, shape architecture across training and data systems, and translate diverse needs into a coherent platform.

Qualifications

  • MS or PhD in CS/ML or equivalent.
  • 15+ years building large-scale ML or distributed systems.
  • Deep expertise in foundation model inference engines.
  • Experience leading diverse engineering teams.
  • Experience partnering with ML researchers and modeling teams.

Responsibilities

  • Set and drive the technical vision for the foundation model inference engine.
  • Lead performance, efficiency, and reliability improvements.
  • Architect inference systems for training, evaluation, and judge workloads.
  • Collaborate with ML researchers to co-design models and systems.
  • Mentor engineers and define engineering standards.

Skills

Foundation model inference engines
GPU/TPU/accelerator architecture
Distributed systems
JAX
PyTorch
Quantization
Distillation
Compilation
Serving

Education

MS or PhD in Computer Science, Machine Learning, or related field

Tools

Kubernetes
Docker
AWS
GCP
Azure

Job description

Apple seeks a Distinguished Engineer in Cupertino to set the technical direction for our foundation model inference engine. This senior individual‑contributor role partners with ML researchers to define the vision and drive delivery across multiple teams, enabling training, evaluation, and large‑scale inference workloads on Apple silicon.

You will mentor engineers, shape architecture across training and data systems, and translate diverse needs into a coherent platform.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Foundation Models Engineer - ML Systems & Training
Senior Foundation Models Engineer - ML Systems & Training

Apple, Inc. • Cupertino (CA)

On-site
USD 150,000 - 278,000
Apple Benefits
Employee stock programs
Relocation assistance
+2
Lead Architect, Foundation Model Compute Infra
Lead Architect, Foundation Model Compute Infra

Apple, Inc. • Santa Clara (CA)

On-site
USD 216,000 - 394,000
Stock programs
Relocation assistance
Education reimbursement
+1
Senior/Principal Infra Engineer - Foundation AI Compute
Senior/Principal Infra Engineer - Foundation AI Compute

Apple, Inc. • Cupertino (CA)

On-site
USD 180,000 - 320,000
Staff ML Engineer - Inference & Distributed Systems
Staff ML Engineer - Inference & Distributed Systems

Apple, Inc. • Cupertino (CA)

On-site
USD 216,000 - 325,000
Medical and dental coverage
Retirement benefits
Discounted products and services
+3
Senior ML Program Manager: Foundation Models & Evaluations
Senior ML Program Manager: Foundation Models & Evaluations

Apple, Inc. • Cupertino (CA)

On-site
USD 145,000 - 264,000
Foundation Model Post-Training Researcher & Engineer
Foundation Model Post-Training Researcher & Engineer

Apple Inc. • Seattle (WA)

Hybrid
USD 175,000 - 309,000
Medical and dental coverage
Retirement benefits
Employee stock plan
Architect, Foundation Model Compute Infra & Scale
Architect, Foundation Model Compute Infra & Scale

Apple, Inc. • Seattle (WA)

On-site
USD 205,000 - 374,000
Stock options
Relocation assistance
Comprehensive medical and dental
Staff ML Systems Engineer: Inference & Infra Leader
Staff ML Systems Engineer: Inference & Infra Leader

Apple, Inc. • San Francisco (CA)

On-site
USD 216,000 - 325,000
Stock programs
Relocation assistance
Education reimbursement
+1
Lead Foundation Models Researcher AI for Apple Products
Lead Foundation Models Researcher AI for Apple Products

Apple, Inc. • Seattle (WA)

On-site
USD 205,000 - 374,000
Senior AI Foundation Models Program Lead
Senior AI Foundation Models Program Lead

Apple Inc. • Cupertino (CA)

On-site
USD 175,500 - 263,800