Machine Learning Engineer, Foundation Model Services

Apple Inc.; Santa Clara, Northern (CA, KY); On-site; USD 195,000 - 325,000; Full time

Benefits offered by this job

Medical and dental coverage

Retirement benefits

Employee stock programs

Educational expense reimbursement

Relocation assistance

Job summary

Apple Inc. in Santa Clara, California is seeking a senior ML engineer to build production-grade model serving solutions for billions of users.

You will collaborate with the Foundation Model Research team to prototype inference for cutting-edge architectures and optimize inference across hardware. The role emphasizes cloud and on-prem deployment, Kubernetes, Docker, and modern languages like Golang or Python, with a base pay range and extensive benefits.

Qualifications

• 5+ years of industry experience in ML technologies (LLMs, NLP, IR, statistics).
• Experience with high throughput services at supercomputing scale.
• Experience running applications on cloud using Kubernetes and Docker.
• Proficient in building and maintaining systems in Golang or Python.

Responsibilities

• Work with product teams to build production-grade model serving solutions.
• Collaborate with Foundation Model Research to prototype inference for new architectures.
• Build tools to identify bottlenecks in inference across hardware and use cases.

Skills

ML technologies

High throughput services

Golang or Python

Education

Bachelor's degree in Computer Science or related field

Tools

Kubernetes

Docker

Cloud platforms (AWS/Azure)

Job description

Santa Clara, California, United States Machine Learning and AI

Do you feel you think differently, you are eager to break status quo, are bold and ambitious, aren’t afraid to take risks and are passionate to build the best of class technology. If yes, what better place to be at and do this than Apple? At Apple, “we think different, we push the boundaries of computing and intelligence. We build products that bring smile to people’s face”.Foundation Model Services team, within Machine Learning Platform Technologies organization is the back-bone of Apple Intelligence. It builds frameworks, services and tools that power the largest Apple foundation models on servers. Our Infrastructure powers a wide gamut of services at Apple including Apple Search, Apple Music, AppleTV, AppStore, iMessages, Photos & Camera, Spotlight, Safari, Siri and upcoming ever exciting Apple products serving millions of queries every day with incredible low latencies, drawing every ounce of compute from our hardware. As part of this group, you will get a chance to bring Intelligence to billions of users across the world. You will have an opportunity to make a difference in life of people. You will have a chance to work on optimizing billions of parameter language and vision and speech models using state of the art technologies and make it run at scale of Apple.

Description

• Work closely with product teams to build production grade solutions to launch models serving millions of customers in real time.
• Work along side Foundation Model Research team to prototype and develop inference for cutting edge model architectures.
• Build tools to understand bottlenecks in Inference for different hardwares and use cases.

Minimum Qualifications

• 5 year+ industry experience in ML technologies (LLMs, Machine Learning, NLP, Information Retrieval, Statistics).
• Experience with high throughput services particularly at supercomputing scale.
• Proficient with running applications on Cloud (AWS / Azure or equivalent) using Kubernetes, Docker etc.
• Proficient in building and maintaining systems written in modern languages (eg: Golang, python)
• Bachelor’s degree or higher in Computer Science or related technical field.

Preferred Qualifications

• Familiar with one of the popular ML Frameworks like Pytorch, Tensorflow.
• Familiar with fundamental Deep Learning architectures such as Transformers, Encoder/Decoder models.
• Familiarity with Nvidia TensorRT-LLM, vLLLM, DeepSpeed, Nvidia Triton Server etc.

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $184,700 and $324,800, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs.

Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan.

• You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition.
• This role might be eligible for discretionary bonuses or commission payments as well as relocation.

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant

At Apple, we believe accessibility is a fundamental human right. You’ll find that idea reflected in everything here — in our culture, our benefits and our digital tools. By welcoming as many perspectives as possible, we help you build a career where you feel like you belong.

Learn about accessibility in Apple’s workplace

Learn about reasonable accommodations for job applicants