Production-Grade Foundation Model Engineer at Scale

Apple; Santa Clara (CA); On-site; USD 175,000 - 309,000; Full time

Benefits offered by this job

Comprehensive medical and dental覆盖

Retirement benefits

Discretionary employee stock programs

RSU awards

Employee Stock Purchase Plan

Relocation may be available

Bonuses or commission payments

Job summary

Apple is seeking a Machine Learning Engineer for Foundation Model Services in Santa Clara, CA to build production-grade capabilities for real-time model serving across Apple products.

The role focuses on optimizing LLMs, NLP, and related ML technologies, collaborating with researchers and product teams, deploying scalable services on cloud platforms and Kubernetes, and owning progressively larger system areas.

Qualifications

• 2+ years of industry experience shipping production software or ML systems.
• Proficiency in Go or Python.
• Experience deploying services on cloud platforms (AWS/Azure/GCP) using containers and Kubernetes/Docker.
• 5+ years of industry experience in ML technologies including LLMs, ML, NLP, Information Retrieval, and Statistics.
• Experience building or operating high-throughput, low-latency services.
• Strong communication and collaboration across research and product teams.
• Bachelor’s degree or higher in CS or related technical field.

Responsibilities

• Collaborate with product teams to create production-grade model-serving solutions in real time.
• Prototype and develop inference for advanced model architectures with researchers.
• Build tools to identify, measure, and remove performance bottlenecks across hardware environments.
• Develop high-quality code and expand system ownership in a fast-moving field.

Skills

Go

Python

LLMs

NLP

Statistics

Education

Bachelor’s degree or higher in CS or related field

Tools

AWS

Azure

GCP

Kubernetes

Docker

Nvidia TensorRT-LLM

DeepSpeed

Nvidia Triton Server

Job description

Apple is seeking a Machine Learning Engineer for Foundation Model Services in Santa Clara, CA to build production-grade capabilities for real-time model serving across Apple products.

The role focuses on optimizing LLMs, NLP, and related ML technologies, collaborating with researchers and product teams, deploying scalable services on cloud platforms and Kubernetes, and owning progressively larger system areas.