AI Quality & Reliability Architect: Data Pipelines & Validation

Vizient, Inc.; Edina (MN); On-site; USD 135,000 - 237,000; Full time

Benefits offered by this job

Incentive eligible

Comprehensive benefits

Equal opportunity employer

Job summary

Vizient, Inc. is seeking a senior Quality Engineer to lead QA and product validation for an AI-enabled healthcare analytics platform that integrates EHR, ERP, and other health system data.

You will guide data pipelines, ontologies, metrics, APIs, analytics, and AI workflows with scalable validation frameworks and test automation. You will collaborate with Product, Software, Data, and AI teams to translate requirements into acceptance criteria, drive complex issues, and establish shift-left

Qualifications

• Relevant degree preferred.
• 7+ years of relevant experience required.
• Strong hands-on programming and automation skills (Python/Java/TypeScript).
• Experience validating data pipelines, ETL/ELT, APIs, and metrics with SQL.
• Experience CI/CD integration of automated testing and quality gates.
• Experience evaluating AI-enabled apps using LLM eval and grounding validation.

Responsibilities

• Lead the end-to-end Quality Engineering and product validation strategy across data pipelines, ontologies, metrics, APIs, analytics, AI capabilities, and user-facing workflows.
• Design and implement scalable automated validation frameworks for data ingestion, transformations, ontology mappings, business rules, metric calculations, APIs, application workflows, and AI-generated outputs.
• Establish data quality and reconciliation capabilities that validate completeness, accuracy, consistency, source-to-target mappings, lineage, and transformation logic across EHR, ERP, and other healthcare data sources.
• Develop validation strategies for ontologies and operational metrics to ensure concepts, mappings, calculations, aggregations, and analytical outputs remain accurate and consistent as the product evolves.
• Lead quality engineering for AI-enabled capabilities, including LLM evaluation, prompt and workflow testing, grounding and factuality validation, regression testing, agentic workflows, and human-in-the-loop evaluation.

Skills

Python

Java

TypeScript/JS

SQL

Automation

CI/CD

Education

Bachelor's degree preferred

Tools

Palantir Foundry

Palantir AIP

Job description

Vizient, Inc. is seeking a senior Quality Engineer to lead QA and product validation for an AI-enabled healthcare analytics platform that integrates EHR, ERP, and other health system data.

You will guide data pipelines, ontologies, metrics, APIs, analytics, and AI workflows with scalable validation frameworks and test automation. You will collaborate with Product, Software, Data, and AI teams to translate requirements into acceptance criteria, drive complex issues, and establish shift-left