Senior AI Data Engineer — AI-Ready Platform Lead

Vizient; Texas; On-site; USD 102,000 - 179,000; Full time

Benefits offered by this job

Incentive eligible

Benefits package

Job summary

Vizient is seeking an experienced Senior Data Engineer to build an AI-ready data enablement platform across the enterprise. You will implement scalable data pipelines using Azure Databricks, PySpark, Delta Lake, and dbt while enforcing governance, metadata, and reproducible patterns.

You will collaborate with analytics, governance, and platform teams to deliver reusable data products, Unity Catalog governance, and governed access through Starburst/Trino, CI/CD, and IaC practices.

Qualifications

• 5+ years of hands-on data engineering experience building production-grade data platforms.
• Strong experience with Azure Databricks, PySpark, Spark SQL, Delta Lake, Azure Data Factory, SQL, and dbt.
• Experience with Azure DevOps, Git, CI/CD pipelines, and release management practices.

Responsibilities

• Build and support scalable data engineering solutions using Azure Databricks, PySpark, SQL, Delta Lake, Azure Data Factory, dbt, and Unity Catalog.
• Improve metadata-driven Azure Data Factory and Databricks patterns for orchestration, configuration, monitoring, restartability, and operational support.
• Develop reusable accelerators including CI/CD templates, Databricks Asset Bundle patterns, deployment automation, environment configuration, and data product onboarding templates.
• Design, develop, and support dbt models, macros, tests, documentation, and transformation standards for governed analytical data products.
• Provide guidance on appropriate technology selection and implementation patterns across dbt, Databricks notebooks and workflows, Delta Live Tables, Spark, and Starburst/Trino.
• Support cross-domain analytics initiatives by transforming source-refined data into trusted, reusable, business-aligned derivative data products.
• Leverage Unity Catalog to establish and support governed catalogs, schemas, tables, lineage, access controls, naming standards, and certification practices.
• Support Starburst/Trino as an analytical and federated query layer for governed enterprise data consumption.
• Apply Azure DevOps, Git, CI/CD, and Infrastructure as Code (IaC) practices to create repeatable, testable, and environment-aware platform delivery processes.
• Troubleshoot and resolve production issues related to orchestration, transformations, data quality, access management, query performance, deployments, and operational workflows.
• Collaborate with data engineering, analytics, platform, governance, and business teams to establish reusable, scalable, and supportable data engineering patterns.
• Contribute to the evolution of enterprise data engineering standards, governance practices, observability capabilities, and AI-ready data product frameworks.

Skills

Problem solving

Communication

Collaboration

Ownership & judgment

Education

Bachelor's degree preferred

Tools

Azure Databricks

PySpark

Spark SQL

Delta Lake

Azure Data Factory

SQL

dbt

Azure DevOps

Git

CI/CD

Pulumi

Unity Catalog

Starburst/Trino

AKS/Kubernetes

Databricks Asset Bundles

Apache Iceberg

Job description

Vizient is seeking an experienced Senior Data Engineer to build an AI-ready data enablement platform across the enterprise. You will implement scalable data pipelines using Azure Databricks, PySpark, Delta Lake, and dbt while enforcing governance, metadata, and reproducible patterns.

You will collaborate with analytics, governance, and platform teams to deliver reusable data products, Unity Catalog governance, and governed access through Starburst/Trino, CI/CD, and IaC practices.