QA Engineer for AI-Driven Healthcare (Hybrid-Boston)

Lumeris; Boston (MA); Hybrid; USD 85,000 - 114,000; Full time

Benefits offered by this job

Medical Plans

Vision Plans

Dental Plans

PTO

401k

Learning & Development

Job summary

Lumeris is seeking a QA Engineer in Massachusetts to design, develop, and execute end-to-end tests for AI-based workflows across patient-facing and clinical applications. You will ensure accuracy, usability, and compliance while hands-on verifying product releases support clinical safety and trust.

You will perform manual testing and contribute to automated testing across clinical journeys, collaborating with Product, Engineering, Data Science, and clinical teams.

Qualifications

• 2+ years of experience in Quality Assurance (QA), specializing in manual and functional testing across web and mobile applications.
• Hands-on experience using automation tools like Playwright, Selenium or Cypress.
• Strong knowledge of software testing methodologies, test design techniques, defect lifecycle management, and quality best practices.
• Hands-on experience testing AI systems, rule engines, or complex data pipelines.
• Experience validating healthcare AI or clinical decision support tools.
• Experience using tools like Azure DevOps, AWS or GCP, Jira and TestRail.
• Solid understanding of healthcare data standards (FHIR, HL7, claims, or EMRs).
• Strong communication, documentation, and troubleshooting skills.

Responsibilities

• Design and execute comprehensive end-to-end functional test cases and test plans specifically tailored for AI-driven workflows.
• Perform rigorous manual testing and contribute to automated testing across multiple clinical and patient journeys.
• Translate product user stories and acceptance criteria into well‑defined, high‑quality test cases that ensure thorough coverage.
• Validate conversation quality, data integrity, and complex edge cases within natural language AI agent interactions.
• Leverage hands‑on testing experience to systematically conduct end‑to‑end, regression, functional, and security testing across AI‑driven features, interfaces, and backend systems.
• Collaborate with client‑side Product, Engineering, Data Science, and clinical teams to clarify technical requirements and resolve blockers.
• Maintain precise traceability of linking requirements to test cases, defects, and final release signoffs.
• Collaborate with onsite and offshore QA teams to ensure alignment in testing efforts.
• Identify, track, and document software defects, contributing to team QA dashboards and core quality KPIs (such as defect density and overall release health).

Skills

QA

Manual testing

Test design

Communication skills

Education

Bachelor's degree in Information Systems, Healthcare Informatics, or related field

Tools

Playwright

Selenium

Cypress

Azure DevOps

Jira

TestRail

AWS

GCP

Job description

Lumeris is seeking a QA Engineer in Massachusetts to design, develop, and execute end-to-end tests for AI-based workflows across patient-facing and clinical applications. You will ensure accuracy, usability, and compliance while hands-on verifying product releases support clinical safety and trust.

You will perform manual testing and contribute to automated testing across clinical journeys, collaborating with Product, Engineering, Data Science, and clinical teams.