Senior Data Engineer - Data Platforms & AI Pipelines

Vizient, Inc.; Chicago (IL); On-site; USD 102,000 - 179,000; Full time

Job summary

Vizient, Inc. seeks a Data Engineer to design, build, and scale enterprise data products powering analytics and AI. You will develop modern data pipelines on Databricks and cloud-native tech, collaborating with product, analytics, and business teams to deliver trusted, scalable solutions.

You will mentor engineers, contribute to data governance, and help modernize analytics assets while focusing on performance, reliability, and cost efficiency.

Qualifications

• Relevant degree preferred.
• 5+ years of relevant experience required.
• Strong experience with Databricks, Apache Spark, Python, and SQL required.
• Experience designing and building production-grade data pipelines, data products, and data platforms required.
• Experience developing cloud-based data solutions using Azure, AWS, Google Cloud, or comparable cloud technologies required.
• Experience implementing CI/CD, automated testing, monitoring, and deployment practices for data solutions required.

Responsibilities

• Design and build scalable data ingestion, transformation, and delivery pipelines using Databricks, Spark, Python, and SQL.
• Develop curated data products that support analytics, benchmarking, reporting, AI, and operational decision-making.
• Partner with product, analytics, and business teams to translate complex requirements into reliable data solutions.
• Modernize analytical assets into governed production data products.
• Implement data quality, observability, lineage, security, and monitoring practices.

Skills

Databricks

Apache Spark

Python

SQL

Cloud platforms

CI/CD

Data modeling

Large-scale data engineering

Delta Lake

Unity Catalog

Lakehouse architectures

Education

Bachelor’s degree preferred

Tools

Databricks Asset Bundles

Databricks Delta Lake

Databricks Unity Catalog

Job description

Vizient, Inc. seeks a Data Engineer to design, build, and scale enterprise data products powering analytics and AI. You will develop modern data pipelines on Databricks and cloud-native tech, collaborating with product, analytics, and business teams to deliver trusted, scalable solutions.

You will mentor engineers, contribute to data governance, and help modernize analytics assets while focusing on performance, reliability, and cost efficiency.