Lead, AI Quality & Reliability Engineering

Vizient; Edina (MN); On-site; USD 88,900 - 155,500; Full time

Job summary

Vizient is looking for an experienced professional to lead AI Quality Engineering initiatives. In this role, you will ensure the reliability and performance of AI systems, implement best practices, and mentor a team.

The ideal candidate will have extensive experience in Quality Engineering, particularly with AI applications. You will be involved in day-to-day activities that support AI-powered business solutions across various stakeholders.

Qualifications include a Bachelor's degree in a relevant field and significant industry experience.

Qualifications

• 7 or more years of experience in Quality Engineering or related technology disciplines required.
• Experience supporting AI-powered applications and machine learning solutions required.
• Strong analytical and communication skills needed.

Responsibilities

• Lead AI Quality Engineering activities supporting AI-powered applications.
• Implement AI-native testing practices and validation processes.
• Mentor quality engineers and delivery teams.

Skills

Quality Engineering

AI validation

Software Testing

Problem-solving

Education

Bachelor's degree in Computer Science or related field

Tools

AI-assisted testing tools

Automation frameworks

Job description

Summary

In this role, you will lead the day‑to‑day execution and delivery of AI Quality Engineering initiatives supporting Vizient's enterprise AI transformation efforts. You will help establish and scale AI Quality Engineering practices, validation processes, AI‑assisted testing approaches, runtime quality controls, and modern testing frameworks that support the responsible deployment of AI‑powered business solutions. This role combines hands‑on quality engineering leadership, AI‑enabled testing modernization, healthcare workflow validation, team leadership, and cross‑functional delivery coordination to ensure the reliability, performance, and governance of AI‑enabled systems.

Responsibilities

• Lead day‑to‑day AI Quality Engineering activities supporting AI‑powered applications, LLM‑enabled workflows, intelligent automation solutions, agentic systems, and enterprise AI platforms.
• Implement and mature AI Quality Engineering practices, including AI‑native testing approaches, validation processes, runtime quality controls, reusable testing accelerators, and scalable testing frameworks.
• Coordinate AI validation efforts, including functional testing, prompt testing, workflow validation, regression testing, defect management, release readiness, and production quality assurance.
• Partner with AI Engineering, AIOps, LLMOps, Security, Governance, Clinical, Data, and Product teams to ensure scalable and effective quality engineering processes across AI initiatives.
• Support runtime quality and reliability through observability, monitoring, telemetry analysis, incident support, drift detection, distributed tracing, and continuous improvement initiatives.
• Drive adoption of AI‑assisted testing, intelligent automation, reusable test assets, and modern quality engineering practices that improve efficiency and quality outcomes.
• Lead delivery coordination activities including sprint execution, testing planning, issue tracking, risk identification, dependency management, and release support.
• Collaborate with clinical, operational, and engineering stakeholders to validate healthcare workflows, payer operations, and AI‑enabled business processes while supporting responsible AI deployment.
• Mentor quality engineers, analysts, contractors, and delivery teams while fostering a culture of continuous learning, engineering excellence, and operational accountability.

Qualifications

• Bachelor's degree in Computer Science, Information Systems, Engineering, or related field preferred.
• 7 or more years of experience in Quality Engineering, Software Testing, Quality Assurance, or related technology disciplines required.
• Experience supporting AI‑powered applications, machine learning solutions, LLM‑enabled workflows, intelligent automation, or emerging AI technologies required.
• Experience implementing test strategies, validation frameworks, automation solutions, and quality controls across complex enterprise technology environments required.
• Knowledge of AI Quality Engineering concepts including AI validation, prompt testing, model evaluation, runtime assurance, observability, monitoring, and production reliability required.
• Experience partnering with cross‑functional teams including Engineering, Product, Data, Security, Governance, Clinical, and Operations stakeholders required.
• Demonstrated ability to lead testing efforts, manage quality risks, coordinate releases, and support delivery across multiple initiatives required.
• Strong analytical, problem‑solving, and communication skills with the ability to translate technical quality concerns into actionable business recommendations required.
• Experience within healthcare, payer, provider, or highly regulated industries preferred.
• Experience with AI‑assisted testing tools, test automation frameworks, observability platforms, and modern software delivery practices preferred.
• You must be authorized to work in the United States without sponsorship.

Compensation & Benefits

• Estimated hiring range: $88,900.00 to $155,500.00.
• This position is also incentive eligible.