Remote Speech AI Evaluation Engineer

Pittsburgh Tomorrow

Pittsburgh (Allegheny County)

Hybrid

USD 106,000 - 146,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Medical, Dental & Vision
Health Savings Accounts
Health Care & Dependent Care Flexible
Disability Benefits
Life Insurance
Voluntary Benefits
Paid Absences & Retirement Benefits

Job summary

Solventum is hiring a Core Speech AI Evaluation Engineer to lead quality benchmarks for AI-produced medical notes and to implement data analysis pipelines supporting NLP/NLU products. You will collaborate with global teams across languages and participate in a business-hours on-call rotation, with remote/hybrid work options.

The ideal candidate has a background in AI-model quality analysis, linguistics or NLP, and experience with medical software development. Travel up to 5% may be required.

Qualifications

  • Bachelor's degree or higher with 4+ years of data analytics experience or a HS diploma with 8+ years in data analytics.
  • Experience in AI-model quality analysis is required.
  • Additional qualifications include linguistics, NLP/NLU, medical software development, evaluation design, and cross-team collaboration.

Responsibilities

  • Establish quality benchmarks and processes for AI-produced medical notes and automated LLM-as-judge evaluation.
  • Build data analysis pipelines to produce statistical quality reports for R&D and support teams.
  • Provide analytics on company NLP and NLU products across languages (English, German, Spanish, Italian).
  • Collaborate with global teams on multilingual product support.
  • Participate in on-call rotation to resolve tooling issues.

Skills

AI model quality analysis
Linguistics
NLP/NLU
Medical software development
Evaluation design

Education

Bachelor's degree or higher
High School Diploma/GED

Job description

Solventum is hiring a Core Speech AI Evaluation Engineer to lead quality benchmarks for AI-produced medical notes and to implement data analysis pipelines supporting NLP/NLU products. You will collaborate with global teams across languages and participate in a business-hours on-call rotation, with remote/hybrid work options.

The ideal candidate has a background in AI-model quality analysis, linguistics or NLP, and experience with medical software development. Travel up to 5% may be required.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Speech AI Evaluation Engineer
Remote Speech AI Evaluation Engineer

Solventum • Pittsburgh

Hybrid
USD 106,000 - 146,000
Core Speech AI Evaluation Engineer
Core Speech AI Evaluation Engineer

Life in Pittsburgh • Pittsburgh

Hybrid
USD 106,000 - 146,000
Medical, Dental & Vision
Health Savings Accounts
Health Care & Dependent Care Flexible
+4
Core Speech AI Evaluation Engineer
Core Speech AI Evaluation Engineer

Solventum • Pittsburgh

Hybrid
USD 106,000 - 146,000
ML Engineer — Remote Production AI for Healthcare
ML Engineer — Remote Production AI for Healthcare

USA Solventum Health Information Systems, Inc. • Pennsylvania

Hybrid
USD 120,000 - 180,000
Senior ML Engineer (ASR) — Remote, Quality & Evaluation
Senior ML Engineer (ASR) — Remote, Quality & Evaluation

Cresta • United States

Remote
USD 205,000 - 270,000
Comprehensive medical, dental, and vision coverage
Flexible PTO
Paid parental leave
+4
AI Evaluation Platform Engineer
AI Evaluation Platform Engineer

Ellipsis Health • San Francisco (CA)

Hybrid
USD 160,000 - 210,000
401(k) matching
Health insurance
Flex time off
Senior Backend Engineer, AI Evaluations
Senior Backend Engineer, AI Evaluations

Ellipsis Health • San Francisco (CA)

Hybrid
USD 160,000 - 210,000
401(k) matching
Health insurance
Flexible PTO
Remote QA Engineer - AI Data Quality & Evaluation
Remote QA Engineer - AI Data Quality & Evaluation

YO AI Labs • New York (NY)

Remote
USD 34,000 - 69,000
Remote AI Language Quality Specialist
Remote AI Language Quality Specialist

SME.careers • United States

Remote
USD 28,000 - 48,000
Remote Healthcare AI Quality Specialist
Remote Healthcare AI Quality Specialist

Anyone AI Inc. • United States

Remote
USD 83,000 - 124,000