Software Engineering Manager, AIML — LLM Inference Quality

Apple, Inc.

Seattle (WA)

On-site

USD 196,000 - 338,000

Full time

13 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Medical & dental coverage
Stock programs & RSUs
Education reimbursement
Relocation assistance

Job summary

Apple, Inc. in Seattle, WA, seeks a hands‑on Software Engineering Manager to lead the team responsible for Quality, correctness, and stability of LLM inference in production.

You will own automation frameworks, evaluation methodologies, and qualification strategy across models, prompts, serving stacks, and hardware changes. You will hire and grow engineers, shape the roadmap, define quality bars, and partner with senior leadership to align on technical direction.

Qualifications

  • 8+ years in software and/or ML systems development.
  • 3+ years engineering management with multi‑team delivery.
  • Experience architecting test, qualification, or evaluation strategy for large systems.
  • Hands‑on background in C, C++, Objective‑C, or Swift and Python.
  • Ability to drive strategy from idea to production with clear priorities.
  • B.S., M.S., or Ph.D. in Computer Science, Computer Engineering, Electrical Engineering, or equivalent.

Responsibilities

  • Build, mentor, and manage an inclusive team of high‑performing engineers; oversee hiring and onboarding.
  • Define strategic vision and technical roadmap for LLM inference qualification and validation.
  • Drive end‑to‑end multi‑quarter projects balancing speed and architectural stability.
  • Champion evaluation methodology across unit, integration, regression, and end‑to‑end layers.
  • Partner with ML, performance, distributed systems, security, privacy, and platform teams.
  • Oversee AI‑specific risk coverage including prompt injection and data leakage.
  • Ensure infrastructure‑level validation across quantization, KV‑cache, and batching.
  • Invest in observability and AI‑assisted tooling for faster, smarter testing.
  • Present team work to executives to secure resources and direction.

Skills

Software/ML systems
Engineering management
Test/evaluation strategy
C/C++/Swift
Python scripting
Strategic planning
Cross‑functional leadership

Education

B.S./M.S./Ph.D. in CS/CE/EE

Job description

Software Engineering Manager, AIML — LLM Inference Quality

Seattle, Washington, United States Software and Services

Apple is building the next generation of AI data center infrastructure to power large language model (LLM) services at scale. We are looking for a hands-on engineering manager to lead the team that owns the Quality, correctness, consistency, and stability of LLM inference in production.Your team builds the automation frameworks, evaluation methodology, and qualification strategy that give Apple confidence in every model, prompt, serving stack, and infrastructure change before it reaches users. This is the safety net that lets Apple ship frontier AI quickly — without sacrificing quality, safety, or trust. We are seeking a deeply experienced manager who stays close to the technology to drive both the technical roadmap and the delivery of a high-performing team.

Description

As a technical manager, you will lead a team of engineers spanning quality engineering, distributed systems, and applied ML evaluation. Your team qualifies LLM inference and output-correctness automation frameworks for large-scale AI data center deployment and platform validation — validating that outputs remain correct, consistent, and stable as models, weights, prompts, serving runtimes, quantization schemes, and accelerator hardware change underneath them.You will stay close to architecture, design reviews, and trade-offs, and partner with ML engineers, inference/performance engineers, distributed systems teams, and platform teams across Cupertino, Seattle, and other sites. You will hire and grow engineers, shape the team’s roadmap, define quality bars where none exist yet, and represent the team to senior leadership and partners. This role requires strong technical depth, exceptional people‑management skills, and the ability to navigate ambiguity in a fast‑paced environment — including the inherently non‑deterministic, probabilistic nature of generative output.

Responsibilities
  • Build, mentor, and manage an inclusive team of high-performing engineers; drive hiring and onboarding, manage performance, and prioritize team health and growth paths.
  • Define the strategic vision and technical roadmap for LLM inference qualification — output‑correctness automation, regression and CI gating, agentic‑behavior validation, and infrastructure‑level inference validation.
  • Drive execution of complex, multi-quarter projects end-to-end, balancing rapid iteration against long‑term architectural stability and a high quality bar.
  • Champion engineering excellence in evaluation methodology: test‑and‑qualification strategy across unit, integration, regression, and end‑to‑end layers for distributed ML serving systems.
  • Partner cross‑functionally with ML, performance, distributed systems, security, privacy, and platform teams to deliver secure, reliable AI experiences on tight timelines.
  • Oversee AI‑specific risk coverage — prompt injection, data leakage across users and permissions, hallucinated or ungrounded output, safety/refusal/policy compliance, and cost/latency regressions.
  • Ensure infrastructure‑level validation — output parity for quantization, KV-cache, speculative decoding, and batching; output equivalence across serving backends and accelerators.
  • Invest in observability and AI‑assisted tooling — metrics, logging pipelines, distributed tracing, drift monitoring, and agentic QA tooling that makes testing itself smarter and faster.
  • Spot problems before they occur, resolve cross‑functional bottlenecks, and present your team’s work to executive leadership to advocate for resources and technical direction.
Minimum Qualifications
  • 8+ years of experience in software and/or ML systems development, or equivalent experience.
  • 3+ years of engineering management experience, with a proven track record of delivering complex, large‑scale projects across multiple teams or organizations.
  • Experience architecting test, qualification, or evaluation strategy for large‑scale distributed systems — ideally ML serving or inference platforms.
  • Hands-on background in one or more compiled languages (C, C++, Objective‑C, or Swift) and proficiency in a scripting language (e.g., Python).
  • Self‑directed: the ability to drive a strategy or project from a simple idea to production, setting clear priorities and consistently delivering on schedule with measurable outcomes.
  • B.S., M.S., or Ph.D. in Computer Science, Computer Engineering, Electrical Engineering, or equivalent experience.
Preferred Qualifications
  • Experience with machine learning and LLMs — common practical applications and frameworks (e.g., PyTorch, Hugging Face Transformers, or comparable inference/serving stacks).
  • Familiarity with LLM serving and inference optimization (batching, KV-cache, quantization, speculative decoding, distributed/multi‑accelerator serving) and GPU‑accelerated software.
  • Experience using AI/LLMs to improve testing itself — test‑case generation, defect detection, or reducing manual QA effort.
  • Experience with CI/CD, Kubernetes, containers, and cloud‑native systems, and integrating automated evals into release pipelines.
  • Experience with observability and distributed tracing for ML systems (e.g., Splunk, Prometheus, Grafana, LangSmith, or similar) and monitoring for model drift.
  • Experience validating agentic workflows — tool‑use, function‑calling, and multi‑turn coherence.
  • Track record of hiring, developing, and retaining strong engineers, and leading change across multiple sites.

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $195,700 and $338,400, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant

At Apple, we believe accessibility is a fundamental human right. You’ll find that idea reflected in everything here — in our culture, our benefits and our digital tools. By welcoming as many perspectives as possible, we help you build a career where you feel like you belong.

Learn about accessibility in Apple’s workplace

Learn about reasonable accommodations for job applicants

Apple accepts applications to this posting on an ongoing basis.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AIML - Sr Software Engineer - AI, Evaluation
AIML - Sr Software Engineer - AI, Evaluation

Apple, Inc. • Cupertino (CA)

On-site
USD 150,000 - 278,000
Comprehensive medical and dental
Retirement benefits
Employee stock programs
+2
Sr. Applied Scientist, AI Evaluation & Quality Systems
Sr. Applied Scientist, AI Evaluation & Quality Systems

Apple Inc. • Seattle (WA)

On-site
USD 142,000 - 263,000
Apple Benefits
Relocation assistance
Employee stock purchase plan
+2
ML Data & Eval Engineer, Siri Agent Modeling
ML Data & Eval Engineer, Siri Agent Modeling

Apple, Inc. • Cupertino (CA)

On-site
USD 150,000 - 278,000
Comprehensive medical and dental
Retirement benefits
Employee stock programs
+1
AIML - Distinguished Engineer, Foundation Model
AIML - Distinguished Engineer, Foundation Model

Apple, Inc. • Cupertino (CA)

On-site
USD 311,000 - 497,000
AIML - Senior Machine Learning Platform Engineer, Responsible AI and Safety
AIML - Senior Machine Learning Platform Engineer, Responsible AI and Safety

Apple, Inc. • Seattle (WA)

On-site
USD 175,000 - 263,000
Comprehensive medical and dental
Retirement benefits
Employee stock programs
+3
Distinguished Engineer, AI Infrastructure
Distinguished Engineer, AI Infrastructure

Apple Inc. • Seattle (WA)

On-site
USD 296,000 - 472,000
Medical and dental coverage
Retirement benefits
Discounts and services
+3
AIML - Quality Engineering Manager, Responsible AI and Safety
AIML - Quality Engineering Manager, Responsible AI and Safety

Apple, Inc. • Cupertino (CA)

On-site
USD 238,000 - 402,000
Comprehensive medical and dental
Retirement benefits
Discounted products and free services
+2
Software Engineering (AI/ML), Retail and Marcom Engineering
Software Engineering (AI/ML), Retail and Marcom Engineering

Apple, Inc. • Sunnyvale (CA)

On-site
USD 150,000 - 278,000
Stock awards
Relocation assistance
Tuition reimbursement
+1
Software Engineering (AI/ML), Retail and Marcom Engineering
Software Engineering (AI/ML), Retail and Marcom Engineering

Apple Inc. • Sunnyvale (CA)

On-site
USD 150,000 - 278,000
Senior AI Infrastructure Architect
Senior AI Infrastructure Architect

Apple Inc. • Seattle (WA)

Hybrid
USD 296,000 - 472,000
Medical and dental coverage
Retirement benefits
Discounts and services
+3