AI Quality Engineering Lead for Reliable AI Systems

Vizient; Chicago (IL); On-site; USD 89,000 - 156,000; Full time

Job summary

Vizient is seeking a senior-level AI Quality Engineering leader to drive day-to-day activities for AI-powered applications and enterprise AI platforms. You will implement AI-native testing, validation, and scalable testing workflows while coordinating cross-functional teams across AI initiatives.

The role emphasizes mentorship, governance, and collaboration with Clinical, Data, Security, and Product teams to ensure reliable, compliant AI deployments.

Qualifications

• Bachelor’s degree in Computer Science, Information Systems, Engineering, or related field preferred.
• 7+ years of experience in Quality Engineering, Software Testing, Quality Assurance, or related technology disciplines required.
• 1+ years of experience supporting AI Quality Engineering, AI testing, AI validation, AI-enabled automation, or modern AI engineering initiatives preferred.
• Strong experience supporting Quality Engineering or Quality Assurance activities across enterprise platforms, APIs, operational workflows, healthcare applications, or integrated business systems required.
• Experience with enterprise testing practices, test automation frameworks, SDLC methodologies, Agile delivery models, defect management, release validation, and production support coordination required.
• Strong analytical, organizational, communication, collaboration, and leadership skills required.
• Ability to manage multiple priorities within fast‑paced, evolving, and highly collaborative enterprise environments required.
• Experience with Python, APIs, automation frameworks, AI-enabled workflows, or modern software engineering practices preferred.
• Experience supporting AI/ML platforms, orchestration frameworks, runtime monitoring, observability tooling, or AI operational support processes preferred.
• Familiarity with AI-assisted testing, AI evaluation approaches, prompt testing, runtime observability, operational monitoring, drift detection, or AI operational assurance practices preferred.
• Experience supporting enterprise modernization or transformation initiatives involving AI, automation, or operational scaling preferred.

Responsibilities

• Lead day-to-day AI Quality Engineering activities supporting AI-powered applications, LLM-enabled workflows, intelligent automation solutions, agentic systems, and enterprise AI platforms.
• Implement AI Quality Engineering practices, including AI-native testing approaches, validation processes, runtime quality controls, reusable testing accelerators, and scalable testing workflows.
• Coordinate AI validation efforts, including functional testing, prompt testing, workflow validation, regression testing, defect management, release readiness, and production quality assurance.
• Partner with AI Engineering, AIOps, LLMOps, Security, Governance, Clinical, Data, and Product teams to ensure scalable and effective quality engineering processes across AI initiatives.
• Support runtime quality and reliability through observability, monitoring, telemetry analysis, incident support, drift detection, distributed tracing, and continuous improvement initiatives.
• Drive adoption of AI-assisted testing, intelligent automation, reusable test assets, and modern quality engineering practices that improve efficiency and quality outcomes.
• Lead delivery coordination activities including sprint execution, testing planning, issue tracking, risk identification, dependency management, and release support.
• Collaborate with clinical, operational, and engineering stakeholders to validate healthcare workflows, payer operations, and AI-enabled business processes while supporting responsible AI deployment.
• Mentor quality engineers, analysts, contractors, and delivery teams while fostering a culture of continuous learning, engineering excellence, and operational accountability.

Skills

Quality engineering leadership

Quality assurance

Stakeholder collaboration

Mentoring

Agile delivery

Python

APIs

Observability

Test automation

Release coordination

Education

Bachelor’s degree in CS or related

Tools

Observability tooling

LLMOps tools

AI validation tools

Job description

Vizient is seeking a senior-level AI Quality Engineering leader to drive day-to-day activities for AI-powered applications and enterprise AI platforms. You will implement AI-native testing, validation, and scalable testing workflows while coordinating cross-functional teams across AI initiatives.

The role emphasizes mentorship, governance, and collaboration with Clinical, Data, Security, and Product teams to ensure reliable, compliant AI deployments.