ML Engineer, Foundation Models - Real-Time Inference at Scale

Apple Inc.; Seattle (WA); Hybrid; USD 175,000 - 309,000; Full time

Job summary

Apple Inc. in Seattle is seeking a Software Engineer focused on Machine Learning and AI to build production-grade systems that serve real-time model inferences at scale.

You will collaborate with researchers and product teams to prototype architectures, deploy and operate high-throughput services on cloud platforms using containers and Kubernetes, and write clean, reliable code in Go or Python. Required: 2+ years shipping production software, 5+ years ML/AI experience, and a BS in CS or related

Qualifications

• 2+ years of industry experience shipping production software or ML systems.
• Proficiency in Go or Python and experience with containers and Kubernetes.
• 5+ years in ML technologies (LLMs, NLP, IR, statistics).
• Bachelor’s degree in CS or a related technical field.

Responsibilities

• Build production-grade solutions that launch models serving customers in real time.
• Prototype and develop inference for cutting-edge model architectures with researchers.
• Write high-quality code and operate low-latency services at scale.

Skills

Go

Python

Kubernetes

Docker

Cloud platforms

Communication

ML/LLMs

Education

Bachelor’s degree in Computer Science or related field

Tools

TensorRT-LLM

Job description

Apple Inc. in Seattle is seeking a Software Engineer focused on Machine Learning and AI to build production-grade systems that serve real-time model inferences at scale.

You will collaborate with researchers and product teams to prototype architectures, deploy and operate high-throughput services on cloud platforms using containers and Kubernetes, and write clean, reliable code in Go or Python. Required: 2+ years shipping production software, 5+ years ML/AI experience, and a BS in CS or related