Senior Foundation Model Compute Infra Engineer

Apple Inc.; Santa Clara (CA); Hybrid; USD 185,000 - 325,000; Full time

Benefits offered by this job

Medical & dental coverage

Retirement benefits

Stock programs

Tuition reimbursement

Job summary

Apple Inc. is seeking a Senior/Staff Engineer for the Foundation Model Compute Infrastructure team in Santa Clara, CA. You will design and build large-scale infrastructure powering foundation model training, inference, and fine-tuning; onboard accelerators and collaborate with researchers to improve reliability and performance.

You will mentor engineers, optimize latency and throughput, and integrate technologies such as Pathways, Ray, and Beam into scalable services.

Qualifications

• 5+ years building large-scale distributed systems or cloud infra.
• Experience with distributed ML training or inference systems.
• Strong programming skills in Python, Go, or C++.
• Experience with accelerator infrastructure (TPU, GPU).
• Experience with Kubernetes and cluster management.
• Bachelor’s degree in CS/Engineering or related field.

Responsibilities

• Design, build and evolve large-scale model serving and fine-tuning services.
• Develop reliable infra for deployment, autoscaling, and traffic management.
• Improve latency, throughput, and reliability of serving workloads.
• Onboard and benchmark accelerator technologies into compute infra.
• Collaborate with researchers to integrate Pathways, Ray, Beam as services.
• Mentor engineers and influence technical direction across teams.

Skills

Distributed systems

ML training

Python

Go/C++

Kubernetes

Communication

Bachelor's degree

Education

Bachelor's degree in Computer Science or Engineering

Tools

PyTorch

TensorFlow

Ray

Pathways

JAX

vLLM

Job description

Apple Inc. is seeking a Senior/Staff Engineer for the Foundation Model Compute Infrastructure team in Santa Clara, CA. You will design and build large-scale infrastructure powering foundation model training, inference, and fine-tuning; onboard accelerators and collaborate with researchers to improve reliability and performance.

You will mentor engineers, optimize latency and throughput, and integrate technologies such as Pathways, Ray, and Beam into scalable services.