Quality Assurance Engineer

Jobtailor; Boston (MA); On-site; USD 90,000 - 130,000; Full time

Job summary

Jobtailor in Boston is seeking a QA engineer to design and execute tests for AI-driven workflows, with emphasis on healthcare data standards and data integrity. You will contribute to manual and automated testing across clinical journeys and collaborate across product, engineering, and data science teams.

The role requires 2+ years of QA experience, experience with Playwright/Selenium/Cypress, and strong communication skills.

Qualifications

• Bachelor’s degree in Information Systems, Healthcare Informatics, or related field.
• 2+ years of QA experience with manual and functional testing across web and mobile apps.
• Hands-on with automation tools like Playwright, Selenium or Cypress.
• Solid knowledge of testing methodologies, design techniques, defect lifecycle, and quality practices.
• Experience testing AI systems, rule engines, or complex data pipelines.
• Experience validating healthcare AI or clinical decision support tools.
• Authorized to work in the United States; visa sponsorship is unavailable for this role.

Responsibilities

• Design and execute end-to-end functional test cases and plans for AI-driven workflows.
• Perform manual testing and contribute to automation across clinical and patient journeys.
• Translate user stories and acceptance criteria into high-quality test cases.
• Validate conversation quality, data integrity, and edge cases in AI agent interactions.
• Conduct end-to-end, regression, functional, and security testing across AI features and backend systems.
• Collaborate with Product, Engineering, Data Science, and clinical teams to clarify requirements.
• Maintain traceability linking requirements to tests, defects, and release signoffs.
• Collaborate with onsite and offshore QA teams.
• Identify, track, and document defects and contribute to QA dashboards and KPIs.

Skills

Quality Assurance

Manual Testing

Automation Tools

Healthcare Data Standards

AI Systems Testing

Education

Bachelor's degree in Information Systems/Healthcare Informatics

Tools

Playwright

Selenium

Cypress

Azure DevOps

AWS

GCP

Jira

TestRail

Job description

• Design and execute comprehensive end-to-end functional test cases and test plans for AI-driven workflows.


• Perform manual testing and contribute to automated testing across clinical and patient journeys.


• Translate product user stories and acceptance criteria into high-quality test cases.


• Validate conversation quality, data integrity, and edge cases in natural language AI agent interactions.


• Conduct end-to-end, regression, functional, and security testing across AI-driven features, interfaces, and backend systems.


• Collaborate with Product, Engineering, Data Science, and clinical teams to clarify requirements and resolve blockers.


• Maintain traceability linking requirements to test cases, defects, and release signoffs.


• Collaborate with onsite and offshore QA teams.


• Identify, track, and document software defects and contribute to QA dashboards and quality KPIs.

Requirements

• Bachelor’s degree in Information Systems, Healthcare Informatics, or a related field.


• 2+ years of experience in Quality Assurance (QA), specializing in manual and functional testing across web and mobile applications


• Hands-on experience using automation tools like Playwright, Selenium or Cypress


• Strong knowledge of software testing methodologies, test design techniques, defect lifecycle management, and quality best practices.


• Hands-on experience testing AI systems, rule engines, or complex data pipelines.


• Experience validating healthcare AI or clinical decision support tools.


• Experience using tools like Azure DevOps, AWS or GCP, Jira and TestRail.


• Solid understanding of healthcare data standards (FHIR, HL7, claims, or EMRs).


• Strong communication, documentation, and troubleshooting skills.


• Authorized to work in the United States; visa sponsorship is unavailable for this role.

Core Competencies

Demonstrates expertise in Quality Assurance with a focus on manual and functional testing of AI-driven workflows, ensuring high-quality test case design and execution. Proficient in collaborating with cross-functional teams to validate healthcare AI systems and maintain compliance with healthcare data standards.

Highest-signal resume keywords

• Quality Assurance


• Manual Testing


• Automation Tools


• Healthcare Data Standards


• AI Systems Testing

Hard Skills

• Functional Testing


• Test Case Design


• Regression Testing


• Defect Lifecycle Management


• Testing Methodologies


• AI Systems Testing


• Healthcare AI Validation


• Test Design Techniques


• Data Integrity Validation


• Security Testing

Soft Skills

• Strong Communication


• Documentation Skills


• Troubleshooting Skills

Industry Keywords

• Healthcare Informatics


• FHIR


• HL7


• EMRs


• Clinical Decision Support Tools

Tools & Technologies

• Playwright


• Selenium


• Cypress


• Azure DevOps


• AWS


• GCP


• Jira


• TestRail