Senior AI Benchmark Specialist - Audio & Linguistics

Outlier

United States

Remote

USD 52,000 - 71,000

Part time

27 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Outlier is seeking experienced specialists in music, audio, speech and linguistics, or visual design and graphics to help test AI systems on realistic workflows. You will craft practical benchmarks and Linux-verified tasks, then assess AI outputs for domain-specific accuracy and quality.

The role requires demonstrated domain experience and the ability to work with Linux-based workflows, plus an ability to review and refine AI results against instructions.

Qualifications

  • At least six years of relevant professional experience in music/audio, speech/linguistics, or visual media and design.
  • Completed bachelor's degree or higher, an eligible conservatory credential, or ABRSM Grade 8 or equivalent theory training as an alternative credential for relevant work.
  • Practical comfort using a Linux terminal and at least one published work.

Responsibilities

  • Create practical benchmarks using workflows from your specialty, such as audio production, speech analysis, localization, typography, graphics or visual production.
  • Build tasks that can be completed and verified in a Linux terminal.
  • Review AI outputs for domain-specific accuracy, technical quality and adherence to instructions.

Skills

Music/Audio domain
Speech/Linguistics
Visual design

Education

Bachelor's degree or higher
ABRSM Grade 8 or conservatory credential

Tools

Linux shell
Publications (academic/professional)

Job description

Outlier is seeking experienced specialists in music, audio, speech and linguistics, or visual design and graphics to help test AI systems on realistic workflows. You will craft practical benchmarks and Linux-verified tasks, then assess AI outputs for domain-specific accuracy and quality.

The role requires demonstrated domain experience and the ability to work with Linux-based workflows, plus an ability to review and refine AI results against instructions.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Audio & Linguistics AI Benchmark Specialist
Senior Audio & Linguistics AI Benchmark Specialist

Outlier • Arkansas

On-site
USD 55,000 - 68,000
Senior AI Audio & Linguistics Benchmark Specialist
Senior AI Audio & Linguistics Benchmark Specialist

Braintrust • United States

Remote
USD 55,000 - 68,000
Senior Media, Audio & Linguistics Experts - AI Benchmarking
Senior Media, Audio & Linguistics Experts - AI Benchmarking

Braintrust • Puerto Rico

On-site
USD 83,000 - 103,000
Senior Media, Audio & Linguistics Experts - AI Benchmarking
Senior Media, Audio & Linguistics Experts - AI Benchmarking

Outlier • United States

Remote
USD 52,000 - 71,000
Senior Audio, Speech & Visual Design AI Tester
Senior Audio, Speech & Visual Design AI Tester

Braintrust • Puerto Rico

On-site
USD 83,000 - 103,000
Senior Media, Audio & Linguistics Experts - AI Benchmarking
Senior Media, Audio & Linguistics Experts - AI Benchmarking

Outlier • Arkansas

On-site
USD 55,000 - 68,000
Senior Media, Audio & Linguistics Experts - AI Benchmarking
Senior Media, Audio & Linguistics Experts - AI Benchmarking

Braintrust • United States

Remote
USD 55,000 - 68,000
Remote AI Evaluation & Annotation Specialist
Remote AI Evaluation & Annotation Specialist

Scale AI, Inc. • United States

Remote
USD 17,000 - 24,000
Flexible schedule
Freelance/1099 contract
Free access to leading LLMs
+1
Remote AI Audio Evaluation Specialist
Remote AI Audio Evaluation Specialist

Invisible Technologies Inc. • United States

Remote
USD 8,300 - 90,000
Remote Audio Evaluation Architect
Remote Audio Evaluation Architect

Meridial • United States

Remote
USD 8,300 - 90,000