Senior AI Inference Platform Engineer: Scale & Insights

Apple, Inc.; Seattle (WA); On-site; USD 175,000 - 309,000; Full time

Benefits offered by this job

Stock programs

Relocation assistance

Educational reimbursement

Medical and dental coverage

Job summary

Apple’s Seattle team seeks a senior engineer to build tooling, automation, and analysis for our AI inference platform. You’ll craft performance benchmarking, capacity projection models, and data pipelines enabling data-driven decisions for infrastructure and planners.

This role sits at the intersection of AI systems performance, distributed infrastructure, and software engineering to help scale and optimize our inference platform across fleets.

Qualifications

• BS or MS in Computer Science or related technical field.
• Solid understanding of AI/ML inference architecture and performance of serving systems.
• 7+ years in performance and infrastructure engineering in distributed systems.
• 7 years of coding in Python, Go, C++, or similar languages.
• Experience with automation, tooling, and data pipelines for engineering workflows.
• Knowledge of GPU/accelerator architectures in AI workloads.
• Statistical methods for performance analysis and forecasting.
• Clear communication translating data into guidance for teams.

Responsibilities

• Design and build automations to evaluate AI inference performance across hardware generations.
• Develop tooling to surface performance trends, regressions, and insights.
• Build projection models to support long-term capacity planning decisions.
• Analyze performance data to identify bottlenecks and optimization opportunities.
• Partner with AI infrastructure engineers, hardware teams, and planners.
• Create and enhance performance analysis workflows to improve velocity.
• Improve accuracy, coverage, and usability of measurement systems.

Skills

AI/ML inference architecture

Distributed systems performance

Programming in Python/Go/C++

Automation engineering

GPU/accelerator architecture

Statistical analysis for performance

Communication of data-driven guidance

Education

BS or MS in Computer Science or related technical field

Tools

Nsight

Prometheus

Grafana

Kubernetes

TensorRT-LLM

vLLM

Triton

Splunk

Job description

Apple’s Seattle team seeks a senior engineer to build tooling, automation, and analysis for our AI inference platform. You’ll craft performance benchmarking, capacity projection models, and data pipelines enabling data-driven decisions for infrastructure and planners.

This role sits at the intersection of AI systems performance, distributed infrastructure, and software engineering to help scale and optimize our inference platform across fleets.