Senior AI-Ready Data Platform Engineer

RXinsider LTD.; Chicago, Northern (IL, KY); Hybrid; USD 102,000 - 179,000; Full time

Benefits offered by this job

Incentive eligible

Comprehensive benefits

Job summary

Vizient is seeking a senior data engineer to build and enhance a modern, AI-ready data enablement platform that supports cross-domain analytics, governed data products, and reusable engineering patterns across the enterprise. You will enable data producers and analytics teams through guided pathways, reusable accelerators, metadata-driven frameworks, CI/CD patterns, and governance practices.

As a hands-on senior individual contributor, you will combine platform engineering, data transformation,

Qualifications

• 5+ years of hands-on data engineering experience building production-grade data platforms, pipelines, or analytical data products.
• Strong experience with Azure Databricks, PySpark, Spark SQL, Delta Lake, Azure Data Factory, SQL, and dbt.
• Experience with Azure DevOps, Git, PR workflows, CI/CD pipelines, and release management.
• Knowledge of lakehouse architecture, metadata management, data governance, lineage, access control, and operational support.
• Senior individual contributor with ownership, technical judgment, and cross-functional collaboration.

Responsibilities

• Build and support scalable data engineering solutions using Azure Databricks, PySpark, SQL, Delta Lake, Azure Data Factory, dbt, and Unity Catalog.
• Improve metadata-driven Azure Data Factory and Databricks patterns for orchestration, configuration, monitoring, restartability, and operational support.
• Develop reusable accelerators including CI/CD templates, Databricks Asset Bundle patterns, deployment automation, environment configuration, and data product onboarding templates.
• Design, develop, and support dbt models, macros, tests, documentation, and transformation standards for governed analytical data products.
• Provide guidance on technology selection and implementation patterns across dbt, Databricks notebooks and workflows, Delta Live Tables, Spark, and Starburst/Trino.
• Support cross-domain analytics by transforming source-refined data into trusted derivative data products.
• Leverage Unity Catalog to establish governed catalogs, schemas, tables, lineage, access controls, naming standards, and certification practices.
• Support Starburst/Trino as an analytical/federated query layer for governed data consumption.
• Apply Azure DevOps, Git, CI/CD, and Infrastructure as Code (IaC) to create repeatable platform delivery processes.
• Troubleshoot production issues related to orchestration, transformations, data quality, access management, performance, deployments.

Skills

Azure Databricks

PySpark

Spark SQL

Delta Lake

Azure Data Factory

SQL

dbt

Azure DevOps

Git

CI/CD

IaC

Unity Catalog

Starburst/Trino

Kubernetes

Asset Bundles

Apache Iceberg

Governance

GenAI

Pulumi

Education

Bachelor’s degree preferred

Job description

Vizient is seeking a senior data engineer to build and enhance a modern, AI-ready data enablement platform that supports cross-domain analytics, governed data products, and reusable engineering patterns across the enterprise. You will enable data producers and analytics teams through guided pathways, reusable accelerators, metadata-driven frameworks, CI/CD patterns, and governance practices.

As a hands-on senior individual contributor, you will combine platform engineering, data transformation,