Quality Engineer – Healthcare AI/GenAI Testing

Talent Groups; United States; Vor Ort; USD 120.000 - 160.000; Vollzeit

Zusammenfassung

Talent Groups is seeking a seasoned QA / Quality Engineering professional with a strong focus on AI/GenAI/LLM testing. The role demands hands-on validation of AI outputs, bias, safety, and model drift, plus building evaluation frameworks and automation harnesses for robust AI systems.

Ideal candidates will have 5+ years in QA/QA engineering, 3+ years in test automation, and 2+ years in AI testing across RAG, chatbots, and conversational AI.

Qualifikationen

• 5+ years of QA / Quality Engineering experience.
• 3+ years of test automation development experience.
• 2+ years of AI/ML, GenAI, or LLM testing experience.
• Hands-on testing of RAG, Chatbots, Conversational AI, and AI Agents.
• Validate AI outputs for accuracy, reliability, safety, and consistency.
• Test hallucinations, prompt robustness, bias, model drift, and adversarial scenarios.
• Develop AI evaluation frameworks, test harnesses, and automated validation processes.
• Experience with Azure, AWS, or GCP.
• Knowledge of MLOps, AI Governance, security, and compliance.
• Healthcare / Payer / Provider domain experience preferred.

Kenntnisse

QA

Quality Engineering

Test Automation

AI/GenAI/LLM testing

RAG/Chatbots/Conversational AI testing

AI evaluation frameworks

MLOps

AI Governance & Compliance

Healthcare domain experience

Tools

Azure

AWS

GCP

ML Ops tooling

Jobbeschreibung

• 5+ years of QA / Quality Engineering experience.
• 3+ years of test automation development experience.
• 2+ years of AI/ML, GenAI, or LLM testing experience.
• Hands-on testing of RAG, Chatbots, Conversational AI, and AI Agents.
• Validate AI outputs for accuracy, reliability, safety, and consistency.
• Test hallucinations, prompt robustness, bias, model drift, and adversarial scenarios.
• Develop AI evaluation frameworks, test harnesses, and automated validation processes.
• Experience with Azure, AWS, or GCP.
• Knowledge of MLOps, AI Governance, security, and compliance.
• Healthcare / Payer / Provider domain experience preferred.