Speech Processing ML Algorithm Engineer

Apple Inc.; Cupertino (CA); Hybrid; USD 150,000 - 278,000; Full time

Benefits offered by this job

Medical and dental coverage

Retirement benefits

Stock programs

Tuition reimbursement

Relocation assistance

Job summary

Apple Inc. is seeking a Speech Processing ML Algorithm Engineer to advance speech enhancement models with a focus on low-latency processing for shipping hardware.

You will design, train, and evaluate models, such as noise suppression and dereverberation, and collaborate with cross-functional teams to move prototypes into production. The role requires expertise in ML for speech, strong background in audio signal processing, and proficiency in PyTorch and Bash.

Qualifications

• MS or PhD in a computational science field or 3+ years in ML for speech processing.
• Strong expertise in transformers, RNNs and CNNs for audio.
• Experience designing, training, and evaluating ML models for speech enhancement (noise suppression, dereverberation, etc).
• Experience building models for low-latency, real-time requirements, including streaming/causal processing.
• Solid grounding in audio/speech signal processing fundamentals (e.g., STFT).
• Proficiency with PyTorch and Bash, including version control, code review, testing, and reproducible experiments.
• Habit of following state-of-the-art literature, with ability to reproduce and critique published results.
• Knowledge of speech quality metrics (PESQ, STOI, SI-SDR, DNSMOS) and data augmentation.

Responsibilities

• Design, train, and evaluate models for speech enhancement.
• Collaborate with cross-functional teams to bring prototypes through to production.

Skills

Speech ML research

Transformers/RNN/CNN

Low-latency streaming

PyTorch

Audio signal processing

Model evaluation

Education

MS/PhD in computational science

Tools

PyTorch

Bash

Git

Lightning

Hydra

Job description

Cupertino, California, United States Machine Learning and AI

At Apple, new ideas have a way of quickly becoming extraordinary products, services and customer experiences. Sound is an essential and compelling facet of the customer experience - Apple has assembled a world-class Acoustics team that enables our customers to experience music with delight, communicate with clarity and appreciate our products without disturbance from noise. In Apple Acoustics we work with obsessive attention to detail, directly contributing to products that ship to millions of people around the world.The Acoustic ML Algorithm Development team sits in Apple’s Hardware organization and develops the new architectures and training paradigms that define the audio experience of the next generation of Apple hardware along with our counterparts in the Software organization. We also work closely with various teams behind microphones, loudspeakers, wireless communication, silicon, etc and we focus on features that improve the customer experience across speech, music, and general audio. We are searching for a Speech Processing ML Algorithm Engineer to advance our work in the domain of speech enhancement, with an emphasis on low-latency processing applications.

Description

As a Speech Processing ML Algorithm Engineer on the Acoustics ML Algorithm Development team, you will design, train, and evaluate models for speech enhancement. Examples include noise suppression, de-reverberation, echo suppression, and general multi-microphone processing under the low-latency, real-time constraints of shipping hardware. You will work with cross functional teams to bring early prototypes through to production.

Minimum Qualifications

• MS or PhD in a computational science field or 3+ years of experience in the field of ML for speech processing.
• A passion for audio ML research for applied product applications, with a deep understanding of transformers, recurrent and convolutional neural networks, etc.
• Experience designing, training, and evaluating machine learning models for speech enhancement, such as noise suppression, dereverberation, source separation, or echo residual suppression.
• Experience building models that meet low-latency, real-time requirements, including streaming and causal processing, and a clear understanding of the quality, complexity, and latency trade-offs involved.
• Strong grounding in audio and speech signal processing fundamentals, for example STFT analysis/synthesis.
• Proficiency with PyTorch and Bash, including version control, code review, testing, and reproducible experiments.
• A habit of following the state of the art literature closely, with the ability to reproduce, critique, and build on published results.
• Working knowledge of speech quality evaluation, spanning objective metrics (e.g. PESQ, STOI, SI-SDR, DNSMOS) and subjective listening tests, along with the data simulation and augmentation needed to support them.

Preferred Qualifications

• Experience applying machine learning to adaptive filter prediction and control, such as echo cancellation, active noise control, or adaptive beamforming, including hybrid classical and learned systems.
• Familiarity with Lightning and Hydra.
• Familiarity with model efficiency techniques such as quantization-aware training or distillation.
• Experience in high-performance cloud computing for model training.
• Open source contributions to a repository using in the ML audio community.

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $150,400 and $277,600, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant

At Apple, we believe accessibility is a fundamental human right. You’ll find that idea reflected in everything here — in our culture, our benefits and our digital tools.

By welcoming as many perspectives as possible, we help you build a career where you feel like you belong.

Learn about accessibility in Apple’s workplace

Learn about reasonable accommodations for job applicants

Apple accepts applications to this posting on an ongoing basis.