Lead Databricks Platform Engineer — AI & Data Platform

Vizient; Edina (MN); On-site; USD 118,000 - 206,000; Full time

Job summary

Vizient seeks a senior professional to lead the design, implementation, and evolution of its enterprise Databricks platform, enabling analytics, data products, ML, and AI solutions across the organization.

You will develop reusable services, automation frameworks, and self-service capabilities, ensuring scalable, secure, and cost-efficient cloud deployments. Collaboration across EA, Data Eng, PM, Cloud Eng, and Data Science teams is essential.

Qualifications

• Advanced degree preferred; relevant degree required/strongly preferred.
• 7+ years of relevant experience required.
• 3+ years designing, implementing, and supporting Databricks platform solutions required.
• Strong experience with Azure cloud services and enterprise platform engineering required.
• Experience with Terraform, IaC, CI/CD pipelines, and infrastructure automation.
• Knowledge of Delta Lake, Unity Catalog, Spark, and lakehouse architectures.
• Experience developing reusable platform services, automation frameworks, and engineering accelerators.
• Experience supporting ML/AI platform capabilities including MLflow, Model Registry, Feature Store, Vector Search, or MLOps preferred.
• Databricks certification and healthcare industry experience preferred.

Responsibilities

• Lead design, implementation, and evolution of the enterprise Databricks platform and architecture.
• Develop reusable platform services, reference architectures, and engineering standards for analytics, data products, and AI workloads.
• Build IaC, CI/CD pipelines, and automation to improve scalability and reliability.
• Create self-service capabilities, templates, and accelerators for faster onboarding.
• Optimize platform performance, security, governance, and cost across clouds.
• Enable ML/AI platform capabilities with patterns for MLflow, Model Registry, Feature Store, Vector Search.
• Collaborate with EA, Data Eng, PM, Cloud Eng, Data Science, and stakeholders to deliver platform capabilities.
• Evaluate features, run proof-of-concepts, guide platform enhancements for business objectives.
• Provide technical leadership, mentoring, and Platform-as-a-Product practices.
• Drive continuous improvement through automation and adoption of standards.

Skills

Databricks platform

Azure cloud

Terraform / IaC

CI/CD pipelines

Delta Lake / Unity Catalog / Spark

Platform engineering

MLflow / MLOps

Self-service platforms

Automation

Healthcare domain experience

Education

Advanced degree in Computer Science, Engineering, Information Systems, or related field

Tools

Databricks

Terraform

Unity Catalog

Apache Spark

MLflow

Job description

Vizient seeks a senior professional to lead the design, implementation, and evolution of its enterprise Databricks platform, enabling analytics, data products, ML, and AI solutions across the organization.

You will develop reusable services, automation frameworks, and self-service capabilities, ensuring scalable, secure, and cost-efficient cloud deployments. Collaboration across EA, Data Eng, PM, Cloud Eng, and Data Science teams is essential.