Lead Architect, AI Quality and Reliability Engineering

Vizient, Inc

Edina (MN)

On-site

USD 135,000 - 237,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Incentive eligible
Comprehensive benefits

Job summary

Vizient, Inc. in Edina, MN is seeking a Lead Architect for AI Quality and Reliability Engineering to drive QA across data pipelines, ontologies, metrics, and AI-enabled workflows.

You will lead validation strategies, establish automated testing, and ensure end-to-end quality from data ingestion to AI outputs. The role requires 7+ years in quality engineering, strong coding skills in Python/Java/TypeScript, and experience with Palantir Foundry/AIP.

Qualifications

  • 7+ years inQuality Engineering or product validation, with hands-on programming and automation.
  • Strong experience validating data pipelines, transformations, APIs, and analytics.
  • Proficient in Python/Java/TypeScript and SQL with test framework development.
  • Experience in AI-enabled apps validation, LLM testing, and CI/CD integration.
  • Familiarity with Palantir Foundry/AIP and enterprise data platforms.

Responsibilities

  • Lead end-to-end quality engineering and product validation strategy.
  • Design scalable automated validation frameworks for data pipelines and AI outputs.
  • Ensure data quality, lineage, and transformation accuracy across sources.
  • Guide QA for AI capabilities including LLM evaluation and grounding validation.
  • Mentor engineers and drive shift-left quality culture across teams.

Skills

Python/Automation
Java/TypeScript
SQL/DataAnalysis
CI/CD pipelines
Quality engineering
Palantir Foundry/AIP

Education

Bachelor's degree preferred
Higher degree considered

Tools

Palantir Foundry
AIP

Job description

## Lead Architect, AI Quality and Reliability EngineeringApplylocations: Edina, MN 55435time type: Full timeposted on: Posted Todayjob requisition id: 34430RWhen you’re the best, we’re the best. We instill an environment where employees feel engaged, satisfied and able to contribute their unique skills and talents while living and working as their authentic selves. We provide extensive opportunities for personal and professional development, building both employee competence and organizational capability to fuel exceptional performance through an inclusive environment both now and in the future.**Summary:**In this role, you will lead Quality Engineering and product validation for an AI-enabled healthcare operations analytics product that integrates EHR, ERP, and other health system data to deliver standardized ontologies, operational metrics, analytics, and AI-powered workflows. You will serve as a hands-on technical leader, ensuring accuracy, reliability, traceability, and usability across the product lifecycle, from data acquisition and transformation through ontology and metric computation to analytics, AI-generated insights, and end-user workflows. You will establish scalable automation, validation frameworks, and quality engineering practices for solutions built on Palantir Foundry and AIP.**Responsibilities:*** Lead the end-to-end Quality Engineering and product validation strategy across data pipelines, ontologies, metrics, APIs, analytics, AI capabilities, and user-facing workflows.* Design and implement scalable automated validation frameworks for data ingestion, transformations, ontology mappings, business rules, metric calculations, APIs, application workflows, and AI-generated outputs.* Establish data quality and reconciliation capabilities that validate completeness, accuracy, consistency, source-to-target mappings, lineage, and transformation logic across EHR, ERP, and other healthcare data sources.* Develop validation strategies for ontologies and operational metrics to ensure concepts, mappings, calculations, aggregations, and analytical outputs remain accurate and consistent as the product evolves.* Lead quality engineering for AI-enabled capabilities, including LLM evaluation, prompt and workflow testing, grounding and factuality validation, regression testing, agentic workflows, and human-in-the-loop evaluation.* Build reusable test harnesses, representative datasets, automated regression suites, quality gates, and observability capabilities that enable teams to deliver solutions with confidence.* Partner with Product, Software Engineering, Data Engineering, AI Engineering, and healthcare domain experts to translate product requirements into measurable acceptance criteria and drive complex quality issues through root cause analysis and resolution.* Advance a shift-left quality culture by mentoring engineers and establishing practices for testability, automation, data quality, reliability, and AI quality while remaining hands-on with critical product validation capabilities.**Qualifications:*** Relevant degree preferred.* 7 or more years of relevant experience required.* Strong hands-on programming and automation skills using Python, Java, TypeScript/JavaScript, or similar languages, including experience building test frameworks, validation services, or engineering tooling.* Experience validating complex data pipelines, ETL/ELT processes, transformations, analytical datasets, APIs, business rules, and calculated metrics, with strong SQL and data analysis skills.* Experience designing automated data quality, reconciliation, source-to-target validation, regression testing, and end-to-end product validation approaches.* Experience testing modern data-intensive and full-stack applications and integrating automated testing and quality gates into CI/CD pipelines.* Experience evaluating AI-enabled applications using approaches such as LLM evaluation, prompt testing, RAG or grounding validation, and agentic workflow testing.* Experience with observability, telemetry, monitoring, cloud platforms, and modern DevSecOps practices.* Experience with Palantir Foundry/AIP or comparable enterprise data and AI platforms preferred.* Strong ownership, technical leadership, problem-solving, and collaboration skills, with the ability to operate effectively in ambiguity and influence cross-functional teams.**Estimated Hiring Range:**At Vizient, we consider skills, experience, and organizational needs in our compensation approach. Geographic factors may adjust the range estimate and hires typically fall below the top range. Compensation decisions are tailored to individual circumstances. The current salary range for this role is $135,200.00 to $236,600.00.This position is also incentive eligible.Vizient has a comprehensive benefits plan! Please view our benefits here:http://www.vizientinc.com/about-us/careers**Equal Opportunity Employer: Females/Minorities/Veterans/Individuals with Disabilities**The Company is committed to equal employment opportunity to all employees and applicants without regard to race, religion, color, gender identity, ethnicity, age, national origin, sexual orientation, disability status, veteran status or any other category protected by applicable law.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead, AI Quality & Reliability Engineering
Lead, AI Quality & Reliability Engineering

Vizient, Inc • Minnesota

On-site
USD 88,900 - 155,500
Senior AI Quality & Reliability Engineer
Senior AI Quality & Reliability Engineer

Vizient, Inc • Chicago (IL)

On-site
USD 102,000 - 179,000
Lead Architect, AI Quality and Reliability Engineering
Lead Architect, AI Quality and Reliability Engineering

Vizient • Chicago (IL)

On-site
USD 135,000 - 237,000
Lead Architect, AI Quality and Reliability Engineering
Lead Architect, AI Quality and Reliability Engineering

Vizient, Inc. • Chicago (IL)

On-site
USD 135,000 - 237,000
Engineering Team Lead
Engineering Team Lead

Vizient, Inc. • Edina (MN)

On-site
USD 118,000 - 206,000
Director, AI Enablement MN Edina
Director, AI Enablement MN Edina

Vizient, Inc. • Edina (MN)

On-site
USD 135,000 - 237,000
Benefits program
Senior AI Quality & Reliability Engineer
Senior AI Quality & Reliability Engineer

Vizient, Inc. • Edina (MN)

On-site
USD 102,000 - 179,000
Incentive eligible
Associate Principal, AI Solution Architecture
Associate Principal, AI Solution Architecture

Vizient, Inc • Irving (TX)

On-site
USD 157,000 - 290,000
Staff Software Engineer
Staff Software Engineer

Vizient • Chicago (IL)

On-site
USD 118,000 - 206,000
Senior Quality Engineer
Senior Quality Engineer

Vizient, Inc • Irving (TX)

On-site
USD 89,000 - 156,000
Incentive eligible
Comprehensive benefits