Lead AI Quality & Reliability Architect

Vizient, Inc.; Chicago (IL); On-site; USD 135,000 - 237,000; Full time

Job summary

Vizient, Inc. is seeking a senior Quality Engineer to lead testing strategy and build scalable automated frameworks for data pipelines, APIs, analytics, and AI-enabled applications.

You will define validation standards, establish data integrity practices, and drive production readiness across complex data workflows. You will mentor engineers, champion shift-left practices, and continuously improve automation, testing practices, and product reliability, collaborating with Product and Engineering

Responsibilities

• Lead quality engineering strategy and execution, establishing test automation, validation standards, and measurable quality goals across the product.
• Design and develop scalable automated testing frameworks covering data pipelines, APIs, business logic, analytics, AI capabilities, and user-facing applications.
• Establish comprehensive data validation and reconciliation practices to ensure accuracy, completeness, consistency, and integrity of healthcare data and calculated metrics.
• Develop automated testing approaches for AI-enabled applications, including LLM evaluation, output accuracy, regression testing, and agentic workflow validation.
• Build and maintain automated regression suites, test datasets, CI/CD quality gates, and monitoring capabilities to detect defects early and prevent regressions.
• Drive end-to-end product validation, including integration, functional, performance, and reliability testing across complex data and application workflows.
• Partner with Product, Engineering, and domain experts to define acceptance criteria, investigate defects, and ensure production readiness.
• Champion shift-left quality engineering, mentor engineers, and drive continuous improvement in automation, testing practices, and product reliability.
• Develop reusable testing tools and automation frameworks leveraging Palantir Foundry, AIP, and modern AI-assisted development capabilities.
• Evaluate emerging AI testing tools and methodologies to improve testing efficiency, coverage, and reliability.

Job description

Vizient, Inc. is seeking a senior Quality Engineer to lead testing strategy and build scalable automated frameworks for data pipelines, APIs, analytics, and AI-enabled applications.

You will define validation standards, establish data integrity practices, and drive production readiness across complex data workflows. You will mentor engineers, champion shift-left practices, and continuously improve automation, testing practices, and product reliability, collaborating with Product and Engineering