Senior AI Quality & Reliability Architect

Vizient; Chicago (IL); On-site; USD 135,000 - 237,000; Full time

Job summary

Vizient is seeking a senior QA engineer to lead automated testing, data validation, and AI testing across data pipelines and applications. You will design scalable testing frameworks, implement CI/CD quality gates, and collaborate with product and engineering to ensure production readiness.

Responsibilities include building regression suites, validating complex workflows, and mentoring peers in automation best practices, with a focus on healthcare data reliability and product quality.

Qualifications

• Experience building automated testing frameworks.
• Familiarity with data pipelines and APIs.
• Knowledge of AI testing and LLM evaluation.
• Strong CI/CD and monitoring experience.

Responsibilities

• Lead quality engineering strategy and execution with automated testing, validation standards, and quality goals.
• Design scalable automated testing frameworks for data pipelines, APIs, business logic, analytics, AI, and UIs.
• Establish data validation practices to ensure data quality and metric integrity.
• Develop automated testing for AI-enabled apps, including LLM evaluation and regression testing.
• Build/maintain automated regression suites, test data, and CI/CD quality gates.
• Drive end-to-end product validation across integration, functional, performance and reliability testing.
• Partner with Product/Engineering to define acceptance criteria and production readiness.
• Champion shift-left quality engineering and mentor engineers in automation.

Skills

Quality engineering

Test automation

CI/CD

AI testing

Data validation

Tools

Palantir Foundry

AIP

Job description

Vizient is seeking a senior QA engineer to lead automated testing, data validation, and AI testing across data pipelines and applications. You will design scalable testing frameworks, implement CI/CD quality gates, and collaborate with product and engineering to ensure production readiness.

Responsibilities include building regression suites, validating complex workflows, and mentoring peers in automation best practices, with a focus on healthcare data reliability and product quality.