Lead Architect, AI Quality and Reliability Engineering

Vizient

Chicago (IL)

On-site

USD 135,000 - 237,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Vizient is seeking a senior QA engineer to lead automated testing, data validation, and AI testing across data pipelines and applications. You will design scalable testing frameworks, implement CI/CD quality gates, and collaborate with product and engineering to ensure production readiness.

Responsibilities include building regression suites, validating complex workflows, and mentoring peers in automation best practices, with a focus on healthcare data reliability and product quality.

Qualifications

  • Experience building automated testing frameworks.
  • Familiarity with data pipelines and APIs.
  • Knowledge of AI testing and LLM evaluation.
  • Strong CI/CD and monitoring experience.

Responsibilities

  • Lead quality engineering strategy and execution with automated testing, validation standards, and quality goals.
  • Design scalable automated testing frameworks for data pipelines, APIs, business logic, analytics, AI, and UIs.
  • Establish data validation practices to ensure data quality and metric integrity.
  • Develop automated testing for AI-enabled apps, including LLM evaluation and regression testing.
  • Build/maintain automated regression suites, test data, and CI/CD quality gates.
  • Drive end-to-end product validation across integration, functional, performance and reliability testing.
  • Partner with Product/Engineering to define acceptance criteria and production readiness.
  • Champion shift-left quality engineering and mentor engineers in automation.

Skills

Quality engineering
Test automation
CI/CD
AI testing
Data validation

Tools

Palantir Foundry
AIP

Job description

When you’re the best, we’re the best. We instill an environment where employees feel engaged, satisfied and able to contribute their unique skills and talents while living and working as their authentic selves. We provide extensive opportunities for personal and professional development, building both employee competence and organizational capability to fuel exceptional performance through an inclusive environment both now and in the future.

Responsibilities
Required Responsibilities
  • Lead quality engineering strategy and execution, establishing test automation, validation standards, and measurable quality goals across the product.
  • Design and develop scalable automated testing frameworks covering data pipelines, APIs, business logic, analytics, AI capabilities, and user-facing applications.
  • Establish comprehensive data validation and reconciliation practices to ensure accuracy, completeness, consistency, and integrity of healthcare data and calculated metrics.
  • Develop automated testing approaches for AI-enabled applications, including LLM evaluation, output accuracy, regression testing, and agentic workflow validation.
  • Build and maintain automated regression suites, test datasets, CI/CD quality gates, and monitoring capabilities to detect defects early and prevent regressions.
  • Drive end-to-end product validation, including integration, functional, performance, and reliability testing across complex data and application workflows.
  • Partner with Product, Engineering, and domain experts to define acceptance criteria, investigate defects, and ensure production readiness.
  • Champion shift-left quality engineering, mentor engineers, and drive continuous improvement in automation, testing practices, and product reliability.
Preferred Responsibilities
  • Develop reusable testing tools and automation frameworks leveraging Palantir Foundry, AIP, and modern AI-assisted development capabilities.
  • Evaluate emerging AI testing tools and methodologies to improve testing efficiency, coverage, and reliability.
Estimated Hiring Range

At Vizient, we consider skills, experience, and organizational needs in our compensation approach. Geographic factors may adjust the range estimate and hires typically fall below the top range. Compensation decisions are tailored to individual circumstances. The current salary range for this role is $135,200.00 to $236,600.00.

This position is also incentive eligible.

Vizient has a comprehensive benefits plan! Please view our benefits here: http://www.vizientinc.com/about-us/careers

Equal Opportunity Employer: Females/Minorities/Veterans/Individuals with Disabilities

The Company is committed to equal employment opportunity to all employees and applicants without regard to race, religion, color, gender identity, ethnicity, age, national origin, sexual orientation, disability status, veteran status or any other category protected by applicable law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Architect, AI Quality and Reliability Engineering
Lead Architect, AI Quality and Reliability Engineering

Vizient, Inc. • Chicago (IL)

On-site
USD 135,000 - 237,000
Lead, AI Quality & Reliability Engineering
Lead, AI Quality & Reliability Engineering

Vizient, Inc. • Irving (TX)

On-site
USD 88,900 - 155,500
Lead, AI Quality & Reliability Engineering
Lead, AI Quality & Reliability Engineering

Vizient, Inc. • Chicago (IL)

On-site
USD 88,900 - 155,500
Comprehensive benefits plan
Incentive eligibility
Manager, AI Quality & Reliability Engineering
Manager, AI Quality & Reliability Engineering

Vizient, Inc. • Edina (MN)

On-site
USD 88,900 - 155,500
Comprehensive benefits plan
Incentive eligibility
Senior AI Quality & Reliability Engineer
Senior AI Quality & Reliability Engineer

Vizient • Chicago (IL)

On-site
USD 102,000 - 179,000
Senior AI Quality & Reliability Engineer
Senior AI Quality & Reliability Engineer

Vizient • Irving (TX)

On-site
USD 102,000 - 179,000
Incentive eligible
Comprehensive benefits plan
Senior AI Quality & Reliability Engineer
Senior AI Quality & Reliability Engineer

Vizient • Edina (MN)

On-site
USD 102,000 - 179,000
Incentive eligible
Comprehensive benefits
Senior AI Quality & Reliability Engineer
Senior AI Quality & Reliability Engineer

1 Vizient, Inc. • Chicago (IL)

On-site
USD 102,000 - 179,000
Senior Quality Engineer
Senior Quality Engineer

Vizient, Inc. • Irving (TX)

On-site
USD 89,000 - 156,000
Quality Software Engineer
Quality Software Engineer

Vizient, Inc. • Irving (TX)

On-site
USD 77,000 - 135,000