Senior AI Quality Engineer - GenAI Reliability & Trust

C T Corporation System (DE)

Cape Girardeau (MO)

On-site

USD 140,000 - 190,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Wolters Kluwer Tax and Accounting seeks an experienced Senior AI Quality Engineer to own quality strategy and evaluation systems for AI-powered product experiences. You will architect, build, and maintain evaluation harnesses that measure retrieval accuracy, citation correctness, response quality, safety, performance, and alignment with customer intent.

You will lead automated testing, observability, and release readiness in CI/CD pipelines.

Qualifications

  • 5+ years of experience in quality engineering or related roles.
  • 2+ years testing AI/ML or non-deterministic systems in production.
  • Strong proficiency with Python test automation frameworks (e.g., Pytest, unittest).
  • Experience validating REST APIs, microservices, data pipelines, and AI workflows.

Responsibilities

  • Own and implement quality engineering for enterprise-scale generative AI apps.
  • Design evaluation harnesses measuring accuracy, groundedness, safety, latency, and cost.
  • Develop automated regression suites tracking quality drift across models and configurations.
  • Lead quality gates for AI releases and advise on risk and readiness.
  • Mentor team members in AI evaluation methods and production-quality practices.

Skills

Quality engineering
AI testing
Python
Pytest
unittest
REST APIs
CI/CD
Observability
Regression testing
Non-deterministic testing
SDET
Agile collaboration

Tools

Pytest
unittest

Job description

Wolters Kluwer Tax and Accounting seeks an experienced Senior AI Quality Engineer to own quality strategy and evaluation systems for AI-powered product experiences. You will architect, build, and maintain evaluation harnesses that measure retrieval accuracy, citation correctness, response quality, safety, performance, and alignment with customer intent.

You will lead automated testing, observability, and release readiness in CI/CD pipelines.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Quality Engineer - GenAI & Observability
Senior AI Quality Engineer - GenAI & Observability

Wolters Kluwer • Cape Girardeau (MO)

On-site
USD 120,000 - 150,000
Senior Product Software Engineer - AI Quality Engineering
Senior Product Software Engineer - AI Quality Engineering

C T Corporation System (DE) • Cape Girardeau (MO)

On-site
USD 140,000 - 190,000
Senior Product Manager — AI Quality & Evaluation
Senior Product Manager — AI Quality & Evaluation

Wolters Kluwer • Chicago (IL)

Hybrid
USD 118,000 - 207,000
Medical, Dental, & Vision Plans
401(k) matching
Paid parental leave
+1
Senior Product Software Engineer - AI Quality Engineering
Senior Product Software Engineer - AI Quality Engineering

Wolters Kluwer • Cape Girardeau (MO)

On-site
USD 120,000 - 150,000
Senior AI Quality & Evaluation Product Manager
Senior AI Quality & Evaluation Product Manager

Wolters Kluwer • United States

Hybrid
USD 108,000 - 188,000
Senior AI Quality Engineer - SaaS Quality Leader
Senior AI Quality Engineer - SaaS Quality Leader

affinipay1 • United States

Hybrid
USD 53,000 - 81,000
Flexible Time Off
13 paid public holidays
Paid sick leave
+2
Senior AI Quality Architect & Testing Leader
Senior AI Quality Architect & Testing Leader

TEKsystems • United States

Remote
USD 128,000 - 192,000
Medical, Dental, Vision
401(k) Retirement Plan
Life Insurance
+4
Senior AI Platform Architect
Senior AI Platform Architect

Wolters Kluwer • Texas

On-site
USD 108,000 - 188,000
Health benefits
401(k)
FSA/HSA
+4
Senior AI Product Engineer - Software & NLP
Senior AI Product Engineer - Software & NLP

Wolters Kluwer • Coppell (TX)

On-site
USD 93,000 - 162,000
Medical
Dental
Vision Plans
+6
Senior QA Engineer: Automation, AI Testing & CI/CD
Senior QA Engineer: Automation, AI Testing & CI/CD

Wolters Kluwer • Coppell (TX)

On-site
USD 71,000 - 125,000
Medical
Dental
Vision Plans
+6