Lead Architect, AI Quality and Reliability Engineering

Vizient, Inc.

Chicago (IL)

On-site

USD 135,000 - 237,000

Full time

7 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Vizient, Inc. is seeking a senior Quality Engineer to lead testing strategy and build scalable automated frameworks for data pipelines, APIs, analytics, and AI-enabled applications.

You will define validation standards, establish data integrity practices, and drive production readiness across complex data workflows. You will mentor engineers, champion shift-left practices, and continuously improve automation, testing practices, and product reliability, collaborating with Product and Engineering

Responsibilities

  • Lead quality engineering strategy and execution, establishing test automation, validation standards, and measurable quality goals across the product.
  • Design and develop scalable automated testing frameworks covering data pipelines, APIs, business logic, analytics, AI capabilities, and user-facing applications.
  • Establish comprehensive data validation and reconciliation practices to ensure accuracy, completeness, consistency, and integrity of healthcare data and calculated metrics.
  • Develop automated testing approaches for AI-enabled applications, including LLM evaluation, output accuracy, regression testing, and agentic workflow validation.
  • Build and maintain automated regression suites, test datasets, CI/CD quality gates, and monitoring capabilities to detect defects early and prevent regressions.
  • Drive end-to-end product validation, including integration, functional, performance, and reliability testing across complex data and application workflows.
  • Partner with Product, Engineering, and domain experts to define acceptance criteria, investigate defects, and ensure production readiness.
  • Champion shift-left quality engineering, mentor engineers, and drive continuous improvement in automation, testing practices, and product reliability.
  • Develop reusable testing tools and automation frameworks leveraging Palantir Foundry, AIP, and modern AI-assisted development capabilities.
  • Evaluate emerging AI testing tools and methodologies to improve testing efficiency, coverage, and reliability.

Job description

When you're the best, we're the best. We instill an environment where employees feel engaged, satisfied and able to contribute their unique skills and talents while living and working as their authentic selves. We provide extensive opportunities for personal and professional development, building both employee competence and organizational capability to fuel exceptional performance through an inclusive environment both now and in the future.

Responsibilities:
  • Lead quality engineering strategy and execution, establishing test automation, validation standards, and measurable quality goals across the product.
  • Design and develop scalable automated testing frameworks covering data pipelines, APIs, business logic, analytics, AI capabilities, and user-facing applications.
  • Establish comprehensive data validation and reconciliation practices to ensure accuracy, completeness, consistency, and integrity of healthcare data and calculated metrics.
  • Develop automated testing approaches for AI-enabled applications, including LLM evaluation, output accuracy, regression testing, and agentic workflow validation.
  • Build and maintain automated regression suites, test datasets, CI/CD quality gates, and monitoring capabilities to detect defects early and prevent regressions.
  • Drive end-to-end product validation, including integration, functional, performance, and reliability testing across complex data and application workflows.
  • Partner with Product, Engineering, and domain experts to define acceptance criteria, investigate defects, and ensure production readiness.
  • Champion shift-left quality engineering, mentor engineers, and drive continuous improvement in automation, testing practices, and product reliability.
Preferred Responsibilities:
  • Develop reusable testing tools and automation frameworks leveraging Palantir Foundry, AIP, and modern AI-assisted development capabilities.
  • Evaluate emerging AI testing tools and methodologies to improve testing efficiency, coverage, and reliability.
Estimated Hiring Range:

At Vizient, we consider skills, experience, and organizational needs in our compensation approach. Geographic factors may adjust the range estimate and hires typically fall below the top range. Compensation decisions are tailored to individual circumstances. The current salary range for this role is $135,200.00 to $236,600.00.

This position is also incentive eligible.

Vizient has a comprehensive benefits plan! Please view our benefits here:

http://www.vizientinc.com/about-us/careers

Equal Opportunity Employer: Females/Minorities/Veterans/Individuals with Disabilities

The Company is committed to equal employment opportunity to all employees and applicants without regard to race, religion, color, gender identity, ethnicity, age, national origin, sexual orientation, disability status, veteran status or any other category protected by applicable law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Architect, AI Quality and Reliability Engineering
Lead Architect, AI Quality and Reliability Engineering

Vizient • Chicago (IL)

On-site
USD 135,000 - 237,000
Lead, AI Quality & Reliability Engineering
Lead, AI Quality & Reliability Engineering

Vizient, Inc. • Chicago (IL)

On-site
USD 88,900 - 155,500
Comprehensive benefits plan
Incentive eligibility
Lead, AI Quality & Reliability Engineering
Lead, AI Quality & Reliability Engineering

Vizient, Inc. • Irving (TX)

On-site
USD 88,900 - 155,500
Manager, AI Quality & Reliability Engineering
Manager, AI Quality & Reliability Engineering

Vizient, Inc. • Edina (MN)

On-site
USD 88,900 - 155,500
Comprehensive benefits plan
Incentive eligibility
Senior AI Quality & Reliability Engineer
Senior AI Quality & Reliability Engineer

Vizient • Chicago (IL)

On-site
USD 102,000 - 179,000
Senior AI Quality & Reliability Engineer
Senior AI Quality & Reliability Engineer

Vizient • Irving (TX)

On-site
USD 102,000 - 179,000
Incentive eligible
Comprehensive benefits plan
Senior AI Quality & Reliability Engineer
Senior AI Quality & Reliability Engineer

Vizient • Edina (MN)

On-site
USD 102,000 - 179,000
Incentive eligible
Comprehensive benefits
Quality Software Engineer
Quality Software Engineer

Vizient, Inc. • Irving (TX)

On-site
USD 77,000 - 135,000
Senior Quality Engineer
Senior Quality Engineer

Vizient, Inc. • Irving (TX)

On-site
USD 89,000 - 156,000
Sr. AI Delivery & Operations Engineer
Sr. AI Delivery & Operations Engineer

Vizient, Inc. • Edina (MN)

On-site
USD 102,400 - 179,000
Incentive eligibility