Research Engineer, Audio Models Onsite (Palo Alto, CA)

Prime Labs

Palo Alto (CA)

On-site

USD 150,000 - 230,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Dedicated GPU capacity
Competitive base salary
Equity package
Small team ownership

Job summary

Prime Labs is seeking a Research Engineer to build systems that convert millions of hours of real lessons into capable audio models for language learning. You will train and iterate across the audio stack—from ASR to speech synthesis—and create data pipelines, training infrastructure, and evaluation tools to move ideas to deployed models for children.

You will work closely with researchers and engineers in our Palo Alto office, taking ownership in a small, high-trust team where roles blend

Qualifications

  • Hands-on experience in ML engineering or research engineering.
  • Strong Python and PyTorch (or JAX).
  • Experience running ML experiments end to end.
  • Experience with large datasets and building robust data pipelines.
  • Comfort in a fast-moving, ambiguous environment.
  • Ability to explain clearly what you tried, what worked, and why.

Responsibilities

  • Build and scale audio data pipelines: quality filtering, transcription alignment and privacy-preserving processing across millions of hours of lessons.
  • Implement, train and iterate on audio models: ASR, pronunciation assessment, speech synthesis and speech-to-speech.
  • Build the training infrastructure, evaluation frameworks and tooling for rapid experiments.
  • Optimize models for low-latency, real-time inference for natural conversations with children.
  • Turn research results into production systems shipped to real learners, taking ownership of your problems.

Skills

ML engineering
Python
End-to-end experiments
Data pipelines
Communication

Education

PhD-level research experience

Tools

PyTorch
JAX

Job description

About Prime Labs

We are a small research lab building foundation models for AI-native education products, starting with English language learning. Our mission is to empower hundreds of millions of children worldwide with AI that understands how they actually speak, identifies and corrects pronunciation errors, provides phoneme-level feedback, adapts to their proficiency, and knows how to help them make progress. Our models are trained on millions of hours of proprietary, one-of-a-kind data from authentic one-on-one lessons between teachers and children, collected over many years of teaching at massive scale and analyzed with the rigor of a research lab. We are backed by DST Global, Reach Capital, K3 Ventures, and others.

About the Team

Our research team brings together AI researchers, learning scientists, veteran educators, and Stanford faculty with a remarkable breadth of experience, from scaling a business to $1B in revenue, to developing the open-source VibeVoice model at Microsoft, developing TeachLM, and working on large-scale scientific computations at Harvard and MIT.

About the Role

As a Research Engineer at Prime Labs, you'll build the systems that turn millions of hours of real lessons into audio models that teach. You'll train and iterate on models across our audio stack, from speech recognition and pronunciation assessment to teacher-like speech synthesis and real-time conversation, and build the data pipelines, training infrastructure and evaluation tooling that let us go from research idea to a model in front of children quickly.

This role is for someone who takes full ownership, moves with urgency and is comfortable when the problem isn't fully defined yet. You'll work side by side with our research scientists and engineers in our Palo Alto office, in a small, high-trust team where everyone does both research and engineering.

What You'll Do
  • Build and scale our audio data pipelines: quality filtering, transcription alignment and privacy-preserving processing across millions of hours of lessons

  • Implement, train and iterate on audio models, from ASR and pronunciation assessment to speech synthesis and speech-to-speech

  • Build the training infrastructure, evaluation frameworks and tooling that let us run experiments quickly and reproducibly

  • Optimize models for low-latency, real-time inference so conversations with children feel natural

  • Turn research results into production systems that ship to real learners, and take ownership of the problems you work on

What You'll Bring
  • Hands‑on experience in ML engineering or research engineering, in industry or PhD-level research

  • Strong Python and PyTorch (or JAX), and the ability to implement models cleanly from papers

  • Experience running ML experiments end to end: data processing, training, evaluation and iteration

  • Experience working with large datasets and building robust, scalable data pipelines

  • Comfort in a fast-moving, ambiguous environment where defining the problem is part of the job

  • The ability to explain clearly what you tried, what worked, and why

Nice to Have
  • Experience with speech or audio models: ASR, TTS, speech-to-speech, neural audio codecs or speech-language models

  • Familiarity with autoregressive, diffusion or flow-matching generative models

  • Experience with distributed training, mixed precision, quantization or inference optimization

  • Experience processing large audio datasets: diarization, voice activity detection or forced alignment

  • A competitive programming or olympiad background

What We Offer
  • A one‑of‑a‑kind educational data corpus with millions of hours of authentic teacher-child conversations

  • Real ownership within a small team where your work shapes the whole model

  • Dedicated GPU capacity for large-scale training

  • Impact you can see: your model teaches real children within months

  • Competitive base salary alongside an attractive equity package

Logistics
  • Location: on-site in Palo Alto, CA

  • Global team: we are a global team with offices in California, Budapest (Hungary) and Singapore. We collaborate in person through frequent travel to and from California.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Research Scientist, Audio Models Onsite (Palo Alto, CA)
Senior Research Scientist, Audio Models Onsite (Palo Alto, CA)

Prime Labs • Palo Alto (CA)

On-site
USD 190,000 - 320,000
GPU capacity for large-scale training
Equity package
Ownership within a small team
+1
Research Engineer, Audio Models — Real-Time Ed AI (Onsite)
Research Engineer, Audio Models — Real-Time Ed AI (Onsite)

Prime Labs • Palo Alto (CA)

On-site
USD 150,000 - 230,000
Dedicated GPU capacity
Competitive base salary
Equity package
+1
Research Engineer
Research Engineer

Essence Ventures • San Francisco (CA)

Hybrid
USD 180,000 - 250,000
Salary + equity
Free meals in office
Healthcare
Machine Learning Research Intern 2027
Machine Learning Research Intern 2027

Phonic • San Francisco (CA)

On-site
USD 45,000 - 65,000
Top-tier compensation
Free meals
Off-site & team events
AI Research Engineer- Speech 1
AI Research Engineer- Speech 1

Centific Global Solutions, Inc. • Redmond (WA)

Hybrid
USD 150,000 - 160,000
Competitive compensation
Hybrid/Remote options
GPU infrastructure access
+1
Research Engineer - Data Infrastructure
Research Engineer - Data Infrastructure

ElevenLabs • United States

Remote
USD 140,000 - 200,000
Discretionary stipend
Annual company offsite
Co-working stipend
+1
Research Intern (Fall 2026)
Research Intern (Fall 2026)

Essence Ventures • San Francisco (CA)

On-site
USD 34,440 - 48,216
Free meals
Team off-sites
AI Research Engineer- Speech 1
AI Research Engineer- Speech 1

Centific • Redmond (WA)

Hybrid
USD 150,000 - 160,000
Benefits package
Hybrid/Remote options
GPU infrastructure access
Senior Audio AI Scientist — Education Impact, GPUs & Equity
Senior Audio AI Scientist — Education Impact, GPUs & Equity

Prime Labs • Palo Alto (CA)

On-site
USD 190,000 - 320,000
GPU capacity for large-scale training
Equity package
Ownership within a small team
+1
Research Engineer
Research Engineer

Coinscapture • United States

Hybrid
USD 120,000 - 180,000
Annual discretionary stipend
Annual company offsite
Co-working stipend
+2