Senior AI Quality & Reliability Engineer

Vizient, Inc; Chicago (IL); On-site; USD 102,000 - 179,000; Full time

Job summary

Vizient, Inc. seeks an experienced AI Quality Engineer to lead hands-on design, development, and execution of AI Quality Engineering initiatives supporting Vizient's enterprise AI transformation.

In this role you will design AI‑native testing, validation processes, and scalable frameworks, mentor quality engineers, and collaborate with AI Engineering, Clinical, Data, Security, and Product teams to ensure responsible deployment within healthcare workflows.

Qualifications

• Bachelor's degree in Computer Science with 5+ years in Quality Engineering.
• Advanced degree in CS or Engineering highly preferred.
• 5+ years experience in Quality Engineering, QA, software testing, or enterprise delivery.
• Experience providing technical leadership for testing initiatives, automation programs, or enterprise technology delivery.
• Experience with AI Quality Engineering, AI‑assisted testing, observability, and reliability engineering preferred.
• Healthcare technology or regulated industries experience is a plus.

Responsibilities

• Design, develop, and execute AI Quality Engineering strategies for AI-powered applications and enterprise AI platforms.
• Build scalable AI Quality Engineering practices, including AI native testing, validation, runtime quality controls, and automated testing frameworks.
• Lead AI validation activities including functional, prompt, workflow, regression, and release validation.
• Partner with AI Engineering, AIOps, LLMOps, Security, Governance, Clinical, Data, and Product teams to scale QA processes across enterprise AI initiatives.
• Support runtime reliability through observability, telemetry, distributed tracing, monitoring, drift detection, incident response, and production quality assurance for AI-enabled systems.
• Develop AI evaluation datasets, quality scoring methodologies, and automated testing workflows.
• Collaborate with Clinical, Operational, and Engineering stakeholders to validate healthcare workflows and responsible AI deployment.
• Coordinate testing across Agile delivery teams and manage defects, releases, and production support.
• Mentor Quality Engineers to promote best practices and continuous improvement in AI Quality Engineering.
• Research and recommend emerging AI Quality Engineering technologies to improve enterprise AI quality capabilities.

Skills

Analytical skills

Problem-solving

Leadership

Communication

Collaboration

Education

Bachelor's degree in Computer Science

Advanced degree in CS/Engineering

Job description

Vizient, Inc. seeks an experienced AI Quality Engineer to lead hands-on design, development, and execution of AI Quality Engineering initiatives supporting Vizient's enterprise AI transformation.

In this role you will design AI‑native testing, validation processes, and scalable frameworks, mentor quality engineers, and collaborate with AI Engineering, Clinical, Data, Security, and Product teams to ensure responsible deployment within healthcare workflows.