AIML LLM Inference Quality Engineering Manager

Apple, Inc.

Seattle (WA)

On-site

USD 196,000 - 338,000

Full time

14 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Medical & dental coverage
Stock programs & RSUs
Education reimbursement
Relocation assistance

Job summary

Apple, Inc. in Seattle, WA, seeks a hands‑on Software Engineering Manager to lead the team responsible for Quality, correctness, and stability of LLM inference in production.

You will own automation frameworks, evaluation methodologies, and qualification strategy across models, prompts, serving stacks, and hardware changes. You will hire and grow engineers, shape the roadmap, define quality bars, and partner with senior leadership to align on technical direction.

Qualifications

  • 8+ years in software and/or ML systems development.
  • 3+ years engineering management with multi‑team delivery.
  • Experience architecting test, qualification, or evaluation strategy for large systems.
  • Hands‑on background in C, C++, Objective‑C, or Swift and Python.
  • Ability to drive strategy from idea to production with clear priorities.
  • B.S., M.S., or Ph.D. in Computer Science, Computer Engineering, Electrical Engineering, or equivalent.

Responsibilities

  • Build, mentor, and manage an inclusive team of high‑performing engineers; oversee hiring and onboarding.
  • Define strategic vision and technical roadmap for LLM inference qualification and validation.
  • Drive end‑to‑end multi‑quarter projects balancing speed and architectural stability.
  • Champion evaluation methodology across unit, integration, regression, and end‑to‑end layers.
  • Partner with ML, performance, distributed systems, security, privacy, and platform teams.
  • Oversee AI‑specific risk coverage including prompt injection and data leakage.
  • Ensure infrastructure‑level validation across quantization, KV‑cache, and batching.
  • Invest in observability and AI‑assisted tooling for faster, smarter testing.
  • Present team work to executives to secure resources and direction.

Skills

Software/ML systems
Engineering management
Test/evaluation strategy
C/C++/Swift
Python scripting
Strategic planning
Cross‑functional leadership

Education

B.S./M.S./Ph.D. in CS/CE/EE

Job description

Apple, Inc. in Seattle, WA, seeks a hands‑on Software Engineering Manager to lead the team responsible for Quality, correctness, and stability of LLM inference in production.

You will own automation frameworks, evaluation methodologies, and qualification strategy across models, prompts, serving stacks, and hardware changes. You will hire and grow engineers, shape the roadmap, define quality bars, and partner with senior leadership to align on technical direction.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior LLM Inference QA & Automation Engineer
Senior LLM Inference QA & Automation Engineer

Apple, Inc. • Seattle (WA)

On-site
USD 140,000 - 190,000
AIML - Sr. LLM Inference Quality Engineer
AIML - Sr. LLM Inference Quality Engineer

Apple, Inc. • Seattle (WA)

On-site
USD 140,000 - 190,000
Software Engineering Manager, AIML — LLM Inference Quality
Software Engineering Manager, AIML — LLM Inference Quality

Apple, Inc. • Seattle (WA)

On-site
USD 196,000 - 338,000
Medical & dental coverage
Stock programs & RSUs
Education reimbursement
+1
Head of Responsible AI Quality & Safety
Head of Responsible AI Quality & Safety

Apple, Inc. • Cupertino (CA)

On-site
USD 238,000 - 402,000
Comprehensive medical and dental
Retirement benefits
Discounted products and free services
+2
Senior ML Engineer — Open-Domain QA & LLM Research
Senior ML Engineer — Open-Domain QA & LLM Research

Apple, Inc. • Seattle (WA)

On-site
USD 175,000 - 309,000
Stock options
Relocation assistance
Comprehensive benefits
+1
AI/ML Quality Engineering Manager for Scalable Services
AI/ML Quality Engineering Manager for Scalable Services

MaziCTools • United States

Remote
USD 208,000 - 360,000
Comprehensive medical and dental cover
Retirement benefits
Discounted products & services
+2
AIML - Sr Machine Learning Platform Engineer, Evaluation
AIML - Sr Machine Learning Platform Engineer, Evaluation

Apple, Inc. • Seattle (WA)

On-site
USD 180,000 - 280,000
Senior AIML Evaluation & Optimization Lead
Senior AIML Evaluation & Optimization Lead

Apple, Inc. • Cupertino (CA)

On-site
USD 238,000 - 402,000
Stock options
Relocation assistance
Comprehensive medical/dental coverage
+1
AI/ML Quality Engineer — LLM Evaluation & QA Automation
AI/ML Quality Engineer — LLM Evaluation & QA Automation

INSPYR Solutions • Cupertino (CA)

Hybrid
USD 91,000 - 105,000
Remote-friendly schedule
ML Engineer – LLMs, NLP & Generative AI for Search
ML Engineer – LLMs, NLP & Generative AI for Search

Apple, Inc. • Cupertino (CA)

On-site
USD 180,000 - 260,000