Machine Learning Engineer, Foundation Model Services

Apple; Santa Clara (CA); On-site; USD 175,000 - 309,000; Full time

Benefits offered by this job

Comprehensive medical and dental覆盖

Retirement benefits

Discretionary employee stock programs

RSU awards

Employee Stock Purchase Plan

Relocation may be available

Bonuses or commission payments

Job summary

Apple is seeking a Machine Learning Engineer for Foundation Model Services in Santa Clara, CA to build production-grade capabilities for real-time model serving across Apple products.

The role focuses on optimizing LLMs, NLP, and related ML technologies, collaborating with researchers and product teams, deploying scalable services on cloud platforms and Kubernetes, and owning progressively larger system areas.

Qualifications

• 2+ years of industry experience shipping production software or ML systems.
• Proficiency in Go or Python.
• Experience deploying services on cloud platforms (AWS/Azure/GCP) using containers and Kubernetes/Docker.
• 5+ years of industry experience in ML technologies including LLMs, ML, NLP, Information Retrieval, and Statistics.
• Experience building or operating high-throughput, low-latency services.
• Strong communication and collaboration across research and product teams.
• Bachelor’s degree or higher in CS or related technical field.

Responsibilities

• Collaborate with product teams to create production-grade model-serving solutions in real time.
• Prototype and develop inference for advanced model architectures with researchers.
• Build tools to identify, measure, and remove performance bottlenecks across hardware environments.
• Develop high-quality code and expand system ownership in a fast-moving field.

Skills

Go

Python

LLMs

NLP

Statistics

Education

Bachelor’s degree or higher in CS or related field

Tools

AWS

Azure

GCP

Kubernetes

Docker

Nvidia TensorRT-LLM

DeepSpeed

Nvidia Triton Server

Job description

The Machine Learning Engineer for Foundation Model Services will help Apple build production-grade capabilities to serve large foundation models in real time. This role focuses on optimizing and deploying large language, vision, and speech models across multiple product experiences at Apple scale.

Responsibilities

• Collaborate with product teams to create production-grade solutions that enable model-serving capabilities for customers in real time.
• Work with foundation model researchers to prototype and develop inference for advanced model architectures.
• Build tools to identify, measure, and remove performance bottlenecks across different hardware environments and use cases.
• Develop high-quality code and adapt quickly in a fast-moving field while taking on progressively larger system ownership areas.

Requirements

• 2+ years of industry experience building and shipping production software and/or machine learning systems.
• Proficiency in a modern programming language such as Go or Python.
• Experience deploying and operating services on a cloud platform such as AWS, Azure, GCP, or an equivalent provider, using containers and Kubernetes/Docker.
• 5+ years of industry experience in machine learning technologies including LLMs, Machine Learning, NLP, Information Retrieval, and Statistics.
• Experience building or operating high-throughput, low-latency services.
• Strong communication and collaboration skills, including partnering across research and product teams.
• Bachelor’s degree or higher in Computer Science or a related technical field.

Technologies

Go, Python, AWS, Azure, GCP, containers, Kubernetes, Docker, Nvidia TensorRT-LLM, vLLLM, DeepSpeed, Nvidia Triton Server

Preferred Qualifications

• Familiarity with Nvidia TensorRT-LLM, vLLLM, DeepSpeed, and Nvidia Triton Server.

Benefits

• Comprehensive medical and dental coverage
• Retirement benefits
• Discounted products and free services
• Reimbursement for certain educational expenses, including tuition
• Discretionary employee stock programs, with the opportunity to become an Apple shareholder
• Eligibility for discretionary restricted stock unit awards
• Ability to purchase Apple stock at a discount through voluntary participation in the Employee Stock Purchase Plan
• Role may be eligible for discretionary bonuses or commission payments
• Relocation may be available

Location and Employment Details

Santa Clara, CA (onsite). Salary range: USD 175,000 - 308,500 per year. Minimum experience: 2 years. Education: Bachelor’s degree or higher in Computer Science or a related technical field.