Remote Speech AI Evaluation Engineer

Solventum

Pittsburgh (Allegheny County)

Hybrid

USD 106,000 - 146,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Solventum is seeking a Core Speech AI Evaluation Engineer to lead quality benchmarks for AI-produced medical notes and to build data analysis pipelines supporting NLP/NLU products. You will collaborate with global teams to cover languages like English, German, Spanish, and Italian.

The role requires at least 4 years of data analytics experience and proficiency in AI-model quality analysis and evaluation design. Remote/hybrid work with possible on-site onboarding is available.

Qualifications

  • Bachelor's Degree or higher AND 4 years of data analytics experience.
  • OR
  • High School Diploma/GED AND 8 years of data analytics experience.
  • Experience in AI-model quality analysis.
  • Additional qualifications that could help you succeed even further in this role include:
  • Experience in linguistics and/or human computer interaction.
  • Experience with natural language processing/understanding.
  • Experience with medical/clinical software development.
  • Experience in evaluation design: rater training, blinding, inter-rater agreement, sample sizing, and identifying noise.
  • Specific experience in AI-model quality and safety analysis.
  • Skill in working across team boundaries toward a shared goal.

Responsibilities

  • Leading efforts to establish quality benchmarks and processes for AI-produced medical notes, including automated LLM-as-judge evaluation
  • Implementing data analysis pipelines to produce statistical quality reports for research and development and support teams
  • Supporting overall team efforts to produce meaningful and actionable analytics on company NLP and NLU products
  • Working with teams from around the world on products supporting many languages, including English, German, Spanish, and Italian
  • Participating in a business-hours restricted on-call rotation to resolve team tool errors

Skills

Data analytics
AI-model quality analysis
Linguistics / HCI
NLP / NLU
Medical/clinical software development
Evaluation design
Inter-team collaboration

Education

Bachelor's Degree or higher
High School Diploma/GED

Job description

Solventum is seeking a Core Speech AI Evaluation Engineer to lead quality benchmarks for AI-produced medical notes and to build data analysis pipelines supporting NLP/NLU products. You will collaborate with global teams to cover languages like English, German, Spanish, and Italian.

The role requires at least 4 years of data analytics experience and proficiency in AI-model quality analysis and evaluation design. Remote/hybrid work with possible on-site onboarding is available.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Speech AI Evaluation Engineer
Remote Speech AI Evaluation Engineer

Pittsburgh Tomorrow • Pittsburgh

Hybrid
USD 106,000 - 146,000
Medical, Dental & Vision
Health Savings Accounts
Health Care & Dependent Care Flexible
+4
Core Speech AI Evaluation Engineer
Core Speech AI Evaluation Engineer

Life in Pittsburgh • Pittsburgh

Hybrid
USD 106,000 - 146,000
Medical, Dental & Vision
Health Savings Accounts
Health Care & Dependent Care Flexible
+4
Remote AI Language Quality Specialist
Remote AI Language Quality Specialist

SME.careers • United States

Remote
USD 28,000 - 48,000
Remote German Audio Evaluation Specialist for AI Benchmarks
Remote German Audio Evaluation Specialist for AI Benchmarks

Meridial • United States

Remote
USD 8,300 - 90,000
Senior ML Engineer (ASR) — Remote, Quality & Evaluation
Senior ML Engineer (ASR) — Remote, Quality & Evaluation

Cresta • United States

Remote
USD 205,000 - 270,000
Comprehensive medical, dental, and vision coverage
Flexible PTO
Paid parental leave
+4
Remote AI QC Analyst — Translation & Speech
Remote AI QC Analyst — Translation & Speech

Welo Data • United States

Remote
USD 28,000 - 55,000
Access to AI/LLM workshops
Remote Italian Audio Evaluation Specialist
Remote Italian Audio Evaluation Specialist

Meridial • United States

Remote
USD 8,300 - 90,000
Remote Voice QA & AI Training Evaluator
Remote Voice QA & AI Training Evaluator

Inworld AI • United States

Remote
USD 28,000 - 76,000
Remote QA Engineer - AI Data Quality & Evaluation
Remote QA Engineer - AI Data Quality & Evaluation

YO AI Labs • New York (NY)

Remote
USD 34,000 - 69,000
Senior AI Engineer — Real-Time NLP & Speech (Remote)
Senior AI Engineer — Real-Time NLP & Speech (Remote)

Launch Tennessee • United States

Remote
USD 160,000 - 220,000
Competitive salaries
Remote/hybrid environment
Flexible PTO
+1