Real-Time Perception & Multimodal ML Engineer

Apple, Inc.; Cupertino (CA); On-site; USD 150,000 - 278,000; Full time

Benefits offered by this job

Medical & dental

Retirement benefits

Employee discounts & services

Tuition reimbursement

Bonuses/commission

Relocation assistance

Job summary

Apple in Cupertino, CA is seeking a highly capable Perception Algorithm Engineer to advance real-time computer vision and autonomous perception capabilities. You will blend modern deep learning with classical techniques to build robust tracking and multimodal estimation that power Apple products.

You will collaborate with talented engineers and researchers, own challenging edge cases, design evaluation pipelines, and help deploy perception systems within large software stacks while meeting

Qualifications

• PhD in Computer Science, Robotics, or a related field with 3 years industry experience or MS with 2+ years industry experience.
• Proficiency in systems programming (C++/Swift) and writing performant, production-quality code.
• Fluency in Python and modern ML frameworks (e.g., PyTorch, JAX) with a solid foundation in machine learning and traditional perception and state-estimation pipelines.
• Ability to break down complex problems into testable solutions, prioritizing challenging edge cases and accessible experiences for all users.
• Curiosity about new technologies, flexibility, and an openness to ambiguity.

Responsibilities

• Designing and implementing a robust, real-time multi-object tracking system to solve real-world computer vision problems.
• Leveraging multimodal estimates (vision, audio, etc.) to ensure robust, high-fidelity estimation across complex and challenging environments.
• Developing rigorous evaluation frameworks, curating datasets, and defining metrics to benchmark model performance, analyze edge cases, and continuously improve perception pipelines.
• Integrating perception systems into a larger software stack with real-world performance constraints.

Skills

C++/Swift

Python

PyTorch/JAX

Problem solving

Curiosity & flexibility

Education

PhD in CS/Robotics/related field

MS with 2+ years industry experience

Tools

Swift

PyTorch

JAX

Job description

Apple in Cupertino, CA is seeking a highly capable Perception Algorithm Engineer to advance real-time computer vision and autonomous perception capabilities. You will blend modern deep learning with classical techniques to build robust tracking and multimodal estimation that power Apple products.

You will collaborate with talented engineers and researchers, own challenging edge cases, design evaluation pipelines, and help deploy perception systems within large software stacks while meeting