Senior AI Quality Engineer – Healthcare (Remote)

Harris Computer Corp.

Virginia

Remote

USD 120,000 - 160,000

Full time

4 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Career growth
Medical, dental, vision benefits
Stock ownership and retirement plans
Flexible work arrangements
Community involvement

Job summary

Harris Computer Corp. is hiring a Staff AI Engineer (QA) to lead the quality and reliability of AI/ML solutions for healthcare. You will own the evaluation framework, datasets, and error metrics while mentoring teams and defining testing standards.

The role is full-time and remote across the U.S. or Canada, with opportunities to shape the future of AI quality and patient safety through explainable AI and robust testing practices.

Qualifications

  • 7+ years in software or ML engineering, with 3+ years in evaluation or QA for AI systems.
  • Experience designing and building complete systems from prototype to production.
  • Experience building evaluation systems used in production by teams.
  • 2+ years evaluating large language model (LLM) systems in production.

Responsibilities

  • Own end-to-end architecture of core AI system from service layer to evaluation infrastructure.
  • Design and implement evaluation infrastructure, including dataset management and automated test harnesses.
  • Maintain evaluation datasets with clinician-reviewed answers and evolve them with system changes.
  • Create error metrics weighted by severity for clinical or financial impact.
  • Build production monitoring for accuracy, overrides, and safety issues with actionable alerts.
  • Write adversarial tests for AI systems to catch hidden or malicious inputs.
  • Collaborate with product and clinical leads to define accuracy thresholds for expanding capabilities.
  • Adopt emerging AI tools to improve workflows and leverage copilots, chat-based AI, and automation.

Skills

Software/ML engineering
AI evaluation/testing
System design
Production evaluation systems
LLM evaluation
Statistics / accuracy analysis
Evaluation datasets (documents)
Explainable AI (XAI)
Technical communication

Tools

SHAP
LIME
Claude

Job description

Harris Computer Corp. is hiring a Staff AI Engineer (QA) to lead the quality and reliability of AI/ML solutions for healthcare. You will own the evaluation framework, datasets, and error metrics while mentoring teams and defining testing standards.

The role is full-time and remote across the U.S. or Canada, with opportunities to shape the future of AI quality and patient safety through explainable AI and robust testing practices.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff AI QA Engineer – Healthcare Quality Lead (Remote)
Staff AI QA Engineer – Healthcare Quality Lead (Remote)

Harris Computer Corp. • Texas

Remote
USD 120,000 - 160,000
Career growth
Medical/Dental/Vision
Vacation and personal days
+4
Lead AI Quality Assurance Engineer – Remote Healthcare
Lead AI Quality Assurance Engineer – Remote Healthcare

Harris Computer Corp. • New York (NY)

Remote
USD 120,000 - 160,000
Growth opportunities
Medical benefits
Dental benefits
+7
Remote Staff AI QA Engineer - Healthcare AI Quality Leader
Remote Staff AI QA Engineer - Healthcare AI Quality Leader

Harris Computer Corp. • Michigan

Remote
USD 120,000 - 160,000
Career growth
Comprehensive benefits
Vacation + personal days
+1
Staff AI QA Engineer - Healthcare, Remote, High Impact
Staff AI QA Engineer - Healthcare, Remote, High Impact

Harris Computer Corp. • New Mexico

Remote
USD 120,000 - 160,000
Medical benefits
Dental and vision coverage
Vacation plus personal days
+3
Remote Senior AI QA Engineer — Healthcare
Remote Senior AI QA Engineer — Healthcare

Harris Computer Corp. • Tennessee

Remote
USD 120,000 - 160,000
Career growth
Medical, dental, vision benefits
Vacation time (3 weeks) and personal 5
+2
Staff AI Engineer - QA
Staff AI Engineer - QA

Harris Computer Corp. • New York (NY)

Remote
USD 120,000 - 160,000
Growth opportunities
Medical benefits
Dental benefits
+7
Staff AI Engineer - QA
Staff AI Engineer - QA

Harris Computer Corp. • Virginia

Remote
USD 120,000 - 160,000
Career growth
Medical, dental, vision benefits
Stock ownership and retirement plans
+2
Staff AI Engineer - QA
Staff AI Engineer - QA

Harris Computer Corp. • Texas

Remote
USD 120,000 - 160,000
Career growth
Medical/Dental/Vision
Vacation and personal days
+4
Staff AI Engineer - QA
Staff AI Engineer - QA

Harris Computer Corp. • New Mexico

Remote
USD 120,000 - 160,000
Medical benefits
Dental and vision coverage
Vacation plus personal days
+3
Staff AI Engineer - QA
Staff AI Engineer - QA

Harris Computer Corp. • Tennessee

Remote
USD 120,000 - 160,000
Career growth
Medical, dental, vision benefits
Vacation time (3 weeks) and personal 5
+2