AI Quality & Reliability Engineering Lead

Vizient, Inc.; Irving (TX); On-site; USD 102,000 - 179,000; Full time

Benefits offered by this job

Incentive eligible

Comprehensive benefits

Job summary

Vizient, Inc. is seeking an AI Quality Engineering leader to drive hands-on design, development, and execution of AI quality initiatives across enterprise AI platforms.

You will shape AI validation, testing modernization, and runtime observability while mentoring engineers and collaborating with cross-functional teams. The role combines healthcare workflow validation, AI-powered testing, and scalable software quality practices to ensure responsible AI deployment and high reliability in

Qualifications

• Relevant degree preferred. Advanced degree in Computer Science, Engineering, or a related field highly preferred. Bachelor's degree in Computer Science,
• 5+ years of experience in Quality Engineering, Quality Assurance, software testing, enterprise application delivery, technology operations, or related technology functions required.
• 2+ years of experience providing technical leadership for testing initiatives, automation programs, or enterprise technology delivery projects required.
• Experience supporting Quality Engineering or Quality Assurance across enterprise platforms, APIs, healthcare applications, operational workflows, or integrated business systems required.
• Strong knowledge of SDLC, Agile methodologies, test automation frameworks, defect management, release validation, and production support processes required.
• Experience validating AI-powered applications, intelligent automation, ML, LLM, or AI-enabled business workflows preferred.
• Experience with AI Quality Engineering practices, AI-assisted testing, runtime observability, monitoring, telemetry, or reliability engineering preferred.

Responsibilities

• Design, develop, and execute AI Quality Engineering strategies for AI-powered applications and enterprise AI platforms.
• Build scalable AI Quality Engineering practices, including AI-native testing, validation processes, and automated testing frameworks.
• Lead AI validation activities: functional testing, prompt validation, workflow testing, regression testing, release validation.
• Partner with AI Engineering, AIOps, Security, Governance, Clinical, Data, and Product teams to deploy scalable processes.
• Support runtime reliability through observability, telemetry, distributed tracing, monitoring, and incident response for AI systems.
• Develop evaluation frameworks, validation datasets, and automated testing workflows to improve AI solution reliability.
• Collaborate with Clinical and Operations teams to validate healthcare workflows and AI-driven processes.
• Coordinate testing across Agile teams, including sprint planning, test execution, defect management, and release readiness.
• Mentor Quality Engineers and promote modern Quality Engineering practices.
• Research and evaluate emerging AI Quality Engineering technologies to improve capabilities.

Skills

AI Quality Engineering

Quality Engineering

Test automation

SDLC knowledge

Agile methodologies

Leadership

Healthcare domain understanding

Problem solving

Cross-functional collaboration

Mentorship

Education

Bachelor's degree in Computer Science

Advanced degree preferred

Tools

CI/CD pipelines

Job description

Vizient, Inc. is seeking an AI Quality Engineering leader to drive hands-on design, development, and execution of AI quality initiatives across enterprise AI platforms.

You will shape AI validation, testing modernization, and runtime observability while mentoring engineers and collaborating with cross-functional teams. The role combines healthcare workflow validation, AI-powered testing, and scalable software quality practices to ensure responsible AI deployment and high reliability in