Distinguished Engineer, AI Infrastructure

Apple Inc.

Cupertino (CA)

On-site

USD 311,000 - 497,000

Full time

35 hours ago
Be an early applicant
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Benefits offered by this job

Stock options
Comprehensive medical coverage
Retirement benefits
Educational reimbursement

Job summary

Apple Inc. seeks a Distinguished Engineer to lead the design and evolution of next-generation AI infrastructure.

You will shape architecture and strategy for large-scale training and inference, spanning multi-cloud compute fleets and accelerator platforms. You’ll collaborate with ML researchers, software engineers, and cross-functional partners to scale performance and reliability across the stack—hardware, software, and cloud infrastructure.

Qualifications

  • Bachelor's degree in CS or related field.
  • 15 years of experience designing and building very large-scale distributed systems.
  • Proficiency in at least 1 backend language (Python, C++, Go, Rust).
  • Proficiency with cloud-native architectures and Kubernetes.
  • Hands-on experience with ML accelerators such as GPUs and TPUs.

Responsibilities

  • Set the technical vision and roadmap for frontier AI infrastructure across a multi-cloud compute fleet.
  • Design and build distributed systems for job scheduling, cluster management, and cost governance.
  • Partner with ML researchers and engineers to optimize end-to-end performance of training and inference workloads.
  • Collaborate with cross-functional teams across cloud infra, finance, and engineering to align strategy.

Skills

Large-scale distributed systems
Backend languages
Kubernetes
ML accelerators
Mentoring engineers

Education

Bachelor's degree
Master's or PhD preferred

Tools

PyTorch
JAX

Job description

Cupertino, California, United States Machine Learning and AI

Apple is where individual imaginations gather together, committing to the values that lead to great work. Every new product we build, service we create, or Apple Store experience we deliver is the result of us making each other’s ideas stronger. That happens because each of us believes we can create something wonderful and share it with the world, changing lives for the better. It’s the diversity of our people and their thinking that inspires the innovation that runs through everything we do. When we bring everybody in, we can do the best work of our lives. Here, you’ll do more than join something — you’ll add something!As part of the Machine Learning Platform Technologies - ML Compute organization, you’ll connect the world’s best researchers with the world’s best AI infrastructure to take on the most challenging problems in machine learning and build the rock-solid foundation for some of Apple’s most innovative products. And this is Apple, so your team will innovate across the entire stack: hardware, software, algorithms — it’s all here.

Description

We are seeking a Distinguished Engineer to provide technical leadership in building and evolving next-generation AI infrastructure at Apple. In this role, you will shape the architecture and long-term technical strategy for large-scale training and inference systems, working at the intersection of AI research, systems, and cloud infrastructure. Your work will directly influence how frontier and production models are trained, deployed, and scaled across diverse accelerator platforms.

Responsibilities
  • Set the technical vision and define the roadmap for frontier AI infrastructure spanning a multi-cloud heterogeneous compute fleet
  • Design and build distributed systems for job scheduling, cluster management, and cost governance
  • Partner closely with ML researchers and engineers to scale and optimize end-to-end performance of AI training and inference workloads
  • Establish connections with cross-functional partners, collaborating with teams across cloud infrastructure, business operations, finance, and engineering
Minimum Qualifications
  • Bachelor’s degree in Computer Science, relevant technical field, or equivalent practical experience
  • 15 years of experience designing and building very large-scale distributed systems
  • Proficiency in at least 1 backend language (e.g., Python, C++, Go, Rust)
  • Proficiency in cloud-native architectures and compute orchestration platforms (e.g., Kubernetes)
  • Hands-on experience working with ML accelerators such as GPUs and TPUs
  • Track record of mentoring senior engineers and setting long-term architectural vision across orgs
Preferred Qualifications
  • Master’s degree or PhD in Computer Science or related technical fields
  • Experience in running distributed training and/or inference workloads in production
  • Expertise in ML systems performance profiling, debugging, and optimization
  • Expertise in deep learning frameworks (e.g., PyTorch, JAX) and their underlying architectures

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $311,100 and $496,900, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits.

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant

At Apple, we believe accessibility is a fundamental human right. You’ll find that idea reflected in everything here — in our culture, our benefits and our digital tools. By welcoming as many perspectives as possible, we help you build a career where you feel like you belong.

Learn about accessibility in Apple’s workplace

Learn about reasonable accommodations for job applicants

Apple accepts applications to this posting on an ongoing basis.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Machine Learning Engineer
Senior Machine Learning Engineer

Apple Inc. • Seattle (WA), Northern (KY)

On-site
USD 175,000 - 309,000
Senior Cloud Infrastructure and AI Efficiency Engineer
Senior Cloud Infrastructure and AI Efficiency Engineer

Apple Inc. • Cupertino (CA)

On-site
USD 185,000 - 325,000
Medical and dental coverage
Employee stock programs
Relocation assistance
+1
AIML - Senior Machine Learning Infrastructure Engineer -ML Compute, ML Platform & Technology
AIML - Senior Machine Learning Infrastructure Engineer -ML Compute, ML Platform & Technology

Apple Inc. • Santa Clara (CA)

On-site
USD 150,400 - 277,600
Staff ML Infrastructure Engineer
Staff ML Infrastructure Engineer

Apple Inc. • Cupertino (CA), Northern (KY)

On-site
USD 185,000 - 325,000
ML Infrastructure Engineer - ML Compute Capacity
ML Infrastructure Engineer - ML Compute Capacity

Apple Inc. • Santa Clara (CA), Northern (KY)

On-site
USD 185,000 - 325,000
Machine Learning Engineer, Foundation Model Services
Machine Learning Engineer, Foundation Model Services

Apple Inc. • Santa Clara (CA), Northern (KY)

On-site
USD 195,000 - 325,000
Medical and dental coverage
Retirement benefits
Employee stock programs
+2
AIML - Distinguished Engineer, Foundation Model
AIML - Distinguished Engineer, Foundation Model

Apple Inc. • Cupertino (CA)

On-site
USD 311,000 - 497,000
Software Development Engineering Manager, ASK Production Engineering
Software Development Engineering Manager, ASK Production Engineering

Apple Inc. • Cupertino (CA)

On-site
USD 268,000 - 402,000
Apple stock program
Relocation assistance
Comprehensive health benefits
+1
Software Engineer, Reliability Engineering, AiDP
Software Engineer, Reliability Engineering, AiDP

Apple Inc. • Sunnyvale (CA), Northern (KY)

On-site
USD 150,000 - 225,000
Stock programs
Relocation assistance
Education reimbursement
+1
Senior Machine Learning Engineer, Analytics & Data Engineering
Senior Machine Learning Engineer, Analytics & Data Engineering

Apple Inc. • Seattle (WA)

On-site
USD 185,000 - 278,000