Staff AI QA Engineer – Healthcare Quality Lead (Remote)

Harris Computer Corp.

Texas

Remote

USD 120,000 - 160,000

Full time

7 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Career growth
Medical/Dental/Vision
Vacation and personal days
Employee stock ownership
RRSP/401k matching
Community involvement
Flexible work arrangements

Job summary

Harris Computer Corp. is hiring a Staff AI Engineer (QA) to lead quality assurance for AI/ML solutions in healthcare. This remote, full-time role focuses on building robust evaluation systems, datasets, and metrics to ensure accuracy, safety, and trust in patient care workflows.

You will mentor teams and establish testing standards while leveraging AI tools to improve efficiency and reliability across the platform.

Qualifications

  • 7+ years in software or ML engineering with at least 3 years in evaluation, testing, or quality for AI systems.
  • Track record of designing and building complete systems from scratch.
  • Experience building and running production evaluation systems.
  • At least 2 years evaluating LLM systems in production.
  • Strong statistical skills for accuracy measurement.
  • 1+ year designing evaluation sets for document extraction/classification.
  • Deep knowledge of explainable AI (XAI) techniques and AI-powered tools.
  • Clear written communication to explain trade-offs to clinicians, engineers, and executives.

Responsibilities

  • Build core AI systems end-to-end and own architecture.
  • Design evaluation infra, dataset management, and automated test harnesses.
  • Develop evaluation datasets with clinician-reviewed correct answers.
  • Create error metrics weighted by severity with clinical/financial impact.
  • Develop production monitoring for accuracy, overrides, and safety issues.
  • Write adversarial tests for AI systems including hidden/malicious content.
  • Collaborate with product and clinical leads on accuracy thresholds.
  • Adopt emerging AI tools to improve workflows and efficiency.

Skills

Software engineering
Machine learning engineering
Evaluation/testing
Quality assurance
Statistical analysis
LLM evaluation
Explainable AI (XAI)
Documentation

Tools

SHAP
LIME
Claude
Great Expectations

Job description

Harris Computer Corp. is hiring a Staff AI Engineer (QA) to lead quality assurance for AI/ML solutions in healthcare. This remote, full-time role focuses on building robust evaluation systems, datasets, and metrics to ensure accuracy, safety, and trust in patient care workflows.

You will mentor teams and establish testing standards while leveraging AI tools to improve efficiency and reliability across the platform.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Quality Engineer – Healthcare (Remote)
Senior AI Quality Engineer – Healthcare (Remote)

Harris Computer Corp. • Virginia

Remote
USD 120,000 - 160,000
Career growth
Medical, dental, vision benefits
Stock ownership and retirement plans
+2
Staff AI QA Engineer - Healthcare, Remote, High Impact
Staff AI QA Engineer - Healthcare, Remote, High Impact

Harris Computer Corp. • New Mexico

Remote
USD 120,000 - 160,000
Medical benefits
Dental and vision coverage
Vacation plus personal days
+3
Remote Staff AI QA Engineer - Healthcare AI Quality Leader
Remote Staff AI QA Engineer - Healthcare AI Quality Leader

Harris Computer Corp. • Michigan

Remote
USD 120,000 - 160,000
Career growth
Comprehensive benefits
Vacation + personal days
+1
Lead AI Quality Assurance Engineer – Remote Healthcare
Lead AI Quality Assurance Engineer – Remote Healthcare

Harris Computer Corp. • New York (NY)

Remote
USD 120,000 - 160,000
Growth opportunities
Medical benefits
Dental benefits
+7
Remote Senior AI QA Engineer — Healthcare
Remote Senior AI QA Engineer — Healthcare

Harris Computer Corp. • Tennessee

Remote
USD 120,000 - 160,000
Career growth
Medical, dental, vision benefits
Vacation time (3 weeks) and personal 5
+2
Staff AI Engineer - QA
Staff AI Engineer - QA

Harris Computer Corp. • Virginia

Remote
USD 120,000 - 160,000
Career growth
Medical, dental, vision benefits
Stock ownership and retirement plans
+2
Staff AI Engineer - QA
Staff AI Engineer - QA

Harris Computer Corp. • Texas

Remote
USD 120,000 - 160,000
Career growth
Medical/Dental/Vision
Vacation and personal days
+4
Staff AI Engineer - QA
Staff AI Engineer - QA

Harris Computer Corp. • Tennessee

Remote
USD 120,000 - 160,000
Career growth
Medical, dental, vision benefits
Vacation time (3 weeks) and personal 5
+2
Staff AI Engineer - QA
Staff AI Engineer - QA

Harris Computer Corp. • New Mexico

Remote
USD 120,000 - 160,000
Medical benefits
Dental and vision coverage
Vacation plus personal days
+3
Staff AI Engineer - QA
Staff AI Engineer - QA

Harris Computer Corp. • Michigan

Remote
USD 120,000 - 160,000
Career growth
Comprehensive benefits
Vacation + personal days
+1