Lead AI Quality Assurance Engineer – Remote Healthcare

Harris Computer Corp.

New York (NY)

Remote

USD 120,000 - 160,000

Full time

Just now
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Growth opportunities
Medical benefits
Dental benefits
Vision benefits
Paid time off
Employee stock ownership
RRSP program
401k matching
Community involvement
Flexible work arrangements

Job summary

Harris Computer is hiring a Staff AI Engineer (QA) to join their expanding team. We’re seeking a seasoned expert to pioneer the quality and reliability of our cutting-edge AI and machine learning solutions for healthcare. The role focuses on QA for AI systems, ensuring robustness, fairness, accuracy, and safety across clinical workflows.

This is a full-time, remote position open to candidates in the U.S. or Canada.

Qualifications

  • 7+ years in software or ML engineering, with 3+ years in evaluation/QA
  • End-to-end AI system design from prototype to production
  • Production evaluation systems used by teams
  • 2+ years evaluating LLM systems in production
  • Strong statistics for measuring accuracy (sampling, CIs, error analysis)
  • Experience designing evaluation sets for document extraction/classification
  • Knowledge of explainable AI (XAI) techniques and tools
  • Clear written communication for clinicians, engineers, and executives

Responsibilities

  • Build core AI system end-to-end and own its architecture
  • Design evaluation infrastructure with datasets and test harnesses
  • Maintain evaluation datasets with clinician-reviewed answers
  • Create error metrics weighted by severity for clinical/financial impact
  • Build production monitoring for accuracy, overrides, and safety with alerts
  • Write adversarial tests for AI systems
  • Define accuracy thresholds with product/clinical leads
  • Adopt emerging AI tools to improve workflows and leverage copilots/automation

Skills

ML engineering
AI QA
Production systems
Statistical analysis
Explainable AI
LLM evaluation
Technical documentation

Tools

Great Expectations
SHAP
LIME
Claude

Job description

Harris Computer is hiring a Staff AI Engineer (QA) to join their expanding team. We’re seeking a seasoned expert to pioneer the quality and reliability of our cutting-edge AI and machine learning solutions for healthcare. The role focuses on QA for AI systems, ensuring robustness, fairness, accuracy, and safety across clinical workflows.

This is a full-time, remote position open to candidates in the U.S. or Canada.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Staff AI QA Engineer - Healthcare AI Quality Leader
Remote Staff AI QA Engineer - Healthcare AI Quality Leader

Harris Computer Corp. • Michigan

Remote
USD 120,000 - 160,000
Career growth
Comprehensive benefits
Vacation + personal days
+1
Senior AI Quality Engineer – Healthcare (Remote)
Senior AI Quality Engineer – Healthcare (Remote)

Harris Computer Corp. • Virginia

Remote
USD 120,000 - 160,000
Career growth
Medical, dental, vision benefits
Stock ownership and retirement plans
+2
Staff AI QA Engineer – Healthcare Quality Lead (Remote)
Staff AI QA Engineer – Healthcare Quality Lead (Remote)

Harris Computer Corp. • Texas

Remote
USD 120,000 - 160,000
Career growth
Medical/Dental/Vision
Vacation and personal days
+4
Staff AI QA Engineer - Healthcare, Remote, High Impact
Staff AI QA Engineer - Healthcare, Remote, High Impact

Harris Computer Corp. • New Mexico

Remote
USD 120,000 - 160,000
Medical benefits
Dental and vision coverage
Vacation plus personal days
+3
Remote Senior AI QA Engineer — Healthcare
Remote Senior AI QA Engineer — Healthcare

Harris Computer Corp. • Tennessee

Remote
USD 120,000 - 160,000
Career growth
Medical, dental, vision benefits
Vacation time (3 weeks) and personal 5
+2
Staff AI Engineer - QA
Staff AI Engineer - QA

Harris Computer Corp. • New York (NY)

Remote
USD 120,000 - 160,000
Growth opportunities
Medical benefits
Dental benefits
+7
Staff AI Engineer - QA
Staff AI Engineer - QA

Harris Computer Corp. • Texas

Remote
USD 120,000 - 160,000
Career growth
Medical/Dental/Vision
Vacation and personal days
+4
Staff AI Engineer - QA
Staff AI Engineer - QA

Harris Computer Corp. • Virginia

Remote
USD 120,000 - 160,000
Career growth
Medical, dental, vision benefits
Stock ownership and retirement plans
+2
Staff AI Engineer - QA
Staff AI Engineer - QA

Harris Computer Corp. • Michigan

Remote
USD 120,000 - 160,000
Career growth
Comprehensive benefits
Vacation + personal days
+1
Staff AI Engineer - QA
Staff AI Engineer - QA

Harris Computer Corp. • Tennessee

Remote
USD 120,000 - 160,000
Career growth
Medical, dental, vision benefits
Vacation time (3 weeks) and personal 5
+2