AI/ML QA Engineer: Generative AI Testing & Governance

Arkhya Tech. Inc.; McLean (VA); On-site; USD 110,000 - 160,000; Full time

Job summary

Arkhya Tech. Inc. seeks an AI/ML QA Engineer to ensure the quality, reliability, and governance of AI and Machine Learning solutions in the healthcare domain.

The role involves validating AI models, testing data pipelines, evaluating model outputs, identifying bias and performance issues, and supporting the end-to-end quality assurance lifecycle for AI-driven applications. The expert will collaborate with data scientists and engineers, develop test plans, automate end-to-end tests, and

Qualifications

• 5–8 years of experience in AI/ML QA within healthcare
• Strong automation and testing mindset
• Experience validating AI/ML models and data pipelines

Responsibilities

• Validate AI/ML models, data pipelines, and outputs
• Evaluate model bias, performance, and hallucinations
• Ensure governance and Responsible AI compliance across the QA lifecycle
• Collaborate with data scientists and engineers to implement end-to-end testing

Skills

AI/ML Testing

Python

SQL

ETL Testing

Snowflake

Databricks

Azure

Healthcare Domain

GenAI Testing

Tools

Selenium

Postman

JIRA

TestNG

PyTest

Job description

Arkhya Tech. Inc. seeks an AI/ML QA Engineer to ensure the quality, reliability, and governance of AI and Machine Learning solutions in the healthcare domain.

The role involves validating AI models, testing data pipelines, evaluating model outputs, identifying bias and performance issues, and supporting the end-to-end quality assurance lifecycle for AI-driven applications. The expert will collaborate with data scientists and engineers, develop test plans, automate end-to-end tests, and