Speech & Audio AI Research Scientist

Innodata; Ridgefield Park (NJ); On-site; USD 160,000 - 185,000; Full time

Job summary

Innodata, a global data engineering company, seeks a Research Scientist to own the science behind speech and audio data for ASR, TTS, and related models in Generative AI contexts. You will define data specs, evaluation criteria, and experiment-driven methods in collaboration with customers and frontier labs.

You will work with multilingual, accented, low-resource, and code-switched speech, publish benchmarks, and guide annotation teams to ensure data quality.

Qualifications

• 5+ years in speech or audio ML with practical results.
• Bachelor’s degree required; advanced degree preferred.
• Trained and evaluated models with PyTorch fundamentals.
• Experience with multilingual, accented, code-switched speech.
• Publications or open-source contributions recognized in the field.

Responsibilities

• Define data specs for ASR, TTS, and audio models into concrete datasets.
• Build evaluation methods beyond WER, including robustness and latency.
• Specify sampling, transcription, and annotation schemas for coverage across languages.
• Run experiments tying data choices to model improvements.
• Publish benchmarks and collaborate with customers and labs.

Skills

Speech/Audio ML

PyTorch

Code-switching

Publications/Open-source

Model evaluation

Education

Bachelor's in CS/EE or related

MS or PhD preferred

Tools

ESPnet

NeMo

SpeechBrain

Kaldi

HuggingFace

Forced alignment

Job description

Innodata, a global data engineering company, seeks a Research Scientist to own the science behind speech and audio data for ASR, TTS, and related models in Generative AI contexts. You will define data specs, evaluation criteria, and experiment-driven methods in collaboration with customers and frontier labs.

You will work with multilingual, accented, low-resource, and code-switched speech, publish benchmarks, and guide annotation teams to ensure data quality.