Machine Learning System Software Engineer

Apple Inc.; Sunnyvale (CA); Hybrid; USD 195,000 - 325,000; Full time

Job summary

Apple Inc. is seeking a Machine Learning System Software Engineer to advance the Apple Neural Engine on-device AI platforms across iPhone, iPad, Mac, and Vision Pro.

You will design APIs for loading, scheduling, and executing models with a focus on performance and low power consumption. The role emphasizes collaboration with driver, firmware, and compiler teams, shaping runtime-to-silicon interfaces and ensuring scalable APIs for evolving hardware capabilities.

Qualifications

• BS and a minimum of 10 years relevant industry experience.
• Experience defining interfaces used by other teams or external developers, with attention to lifecycle, error handling, and forward compatibility.
• Deep proficiency in C and C++ in large, production system software.
• Understanding of runtime systems: process/thread models, memory management, IPC/RPC, and resource lifecycle.
• Understanding of software-hardware interfaces: registers, DMA, command queues, or similar accelerator interaction patterns.
• Experience shipping production system software.

Responsibilities

• Design and implement API's for Apple's Neural Engine - defining how clients load, compile, schedule and execute models on device.
• Architect APIs which provide client control of model lifecycle management, memory allocation strategies, multi-model scheduling, and concurrent execution — ensuring the runtime scales with new hardware capabilities.
• Collaborate deeply with driver, firmware and compiler teams to co-design the runtime-to-silicon interface, ensuring new hardware features are exposed with correct abstractions.
• Profile and optimize end-to-end inference paths, identifying bottlenecks in scheduling, compilation, and inference execution.
• Support clients in adopting APIs and ensuring efficient integration.

Skills

C/C++

Runtime systems

IPC/RPC

Memory management

Performance optimization

System software

Education

BS degree

Tools

TensorRT

ONNX Runtime

Metal

XLA

Swift/Rust

Job description

Machine Learning System Software Engineer

At Apple, we're on the cutting edge of delivering transformative experiences through Artificial Intelligence. If you're passionate about pushing the boundaries of AI and hardware optimization, we want you to join our team! As a Machine Learning System Software Engineer on the Apple Neural Engine (ANE) team, you'll work to bring high-performance, low-power AI solutions to life on iconic Apple products like the Vision Pro, iPhone, iPad, Mac, and more.

Description

This is a dynamic opportunity to work in a creative, collaborative environment while developing groundbreaking technologies that will shape the future of computing! We are looking for an engineer with deep expertise in system software technology who is eager to tackle new challenges and responsibilities as the role evolves. As the position progresses, there will be opportunities to demonstrate technical leadership, influence key design decisions, collaborate with and support other engineers, and help guide the direction of Apple's AI-driven capabilities across the ecosystem. Are you ready to help us deliver the next groundbreaking Apple products?

Responsibilities

• Design and implement API's for Apple's Neural Engine - defining how clients load, compile, schedule and execute models on device
• Architect APIs which provide client control of model lifecycle management, memory allocation strategies, multi-model scheduling, and concurrent execution — ensuring the runtime scales with new hardware capabilities
• Collaborate deeply with driver, firmware and compiler teams to co-design the runtime-to-silicon interface, ensuring new hardware features are exposed with correct abstractions
• Profile and optimize end-to-end inference paths, identifying bottlenecks in scheduling, compilation, and inference execution
• Support clients in adopting APIs and ensuring efficient integration

Minimum Qualifications

• BS and a minimum of 10 years relevant industry experience
• Experience defining interfaces that are used by other teams or external developers, with attention to lifecycle, error handling, and forward compatibility
• Deep proficiency in C and C++ in large, production system software
• Understanding of runtime systems: process/thread models, memory management, IPC/RPC, and resource lifecycle
• Understanding of software-hardware interfaces: registers, DMA, command queues, or similar accelerator interaction patterns
• Experience shipping production system software

Preferred Qualifications

• Experience building or extending ML runtimes, inference engines, or accelerator driver stacks (e.g., TensorRT, ONNX Runtime, XLA, Metal, Vulkan compute, or similar)
• Familiarity with Swift/Rust or another memory-safe systems language
• Familiarity with ML model compilation pipelines and how runtime APIs interact with compiler outputs (graph IR, compiled binaries)
• Experience with multi-client runtime scenarios: arbitrating hardware access, managing priority/QoS, and handling client lifecycle (ex: connect, disconnect, crash recovery)
• Knowledge of neural network inference: operator execution, tensor memory layout, pipelining, and batching strategies
• Strong communication skills and experience working across team boundaries (framework teams, compiler teams, hardware teams)

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $184,700 and $324,800, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits.

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant

At Apple, we believe accessibility is a fundamental human right. You’ll find that idea reflected in everything here — in our culture, our benefits and our digital tools. By welcoming as many perspectives as possible, we help you build a career where you feel like you belong.

Learn about accessibility in Apple’s workplace.

Learn about reasonable accommodations for job applicants.

Apple accepts applications to this posting on an ongoing basis.