Senior Databricks Platform Engineer - AI & Data Platform

Vizient; Chicago (IL); On-site; USD 102,000 - 179,000; Full time

Benefits offered by this job

Incentive eligible

Comprehensive benefits

Job summary

Vizient is seeking a senior Databricks platform engineer to design, build, and enhance the enterprise Databricks platform supporting analytics, data products, ML, and AI initiatives.

You will collaborate with Architecture, Data Engineering, Product Management, Cloud Engineering, and Data Science teams to develop reusable services and self-service capabilities that boost developer experience and productivity.

Qualifications

• 5+ years of relevant experience required.
• 2+ years hands-on with the Databricks platform required.
• Experience with Azure cloud services and cloud-native architectures preferred.
• Experience developing IaC solutions using Terraform and CI/CD pipelines.
• Strong knowledge of Delta Lake, Unity Catalog, Apache Spark, and lakehouse concepts.
• Experience developing automation solutions and reusable engineering components.
• Experience with MLflow, MLOps, AI platform technologies, streaming, or event-driven architectures preferred.
• Strong analytical, problem-solving, collaboration, and communication skills.
• Experience supporting enterprise-scale data platforms and healthcare or regulated environments preferred.

Responsibilities

• Design, build, and enhance the enterprise Databricks platform for analytics and AI initiatives.
• Collaborate with Enterprise Architecture, Data Engineering, Product Management, Cloud Engineering, and Data Science teams.
• Develop reusable platform services, automation frameworks, and self-service capabilities.
• Create and maintain IaC solutions, CI/CD pipelines, and platform automation.
• Improve platform adoption, developer experience, and engineering productivity.
• Support MLflow, Model Registry, Feature Store, Vector Search, and related Databricks capabilities.
• Evaluate new Databricks features and cloud technologies through assessments and PoCs.
• Recommend enhancements and best practices to mature the platform and standards.

Skills

Databricks platform

Delta Lake

Unity Catalog

Apache Spark

MLOps/AI platform

CI/CD concepts

Automation & tooling

Education

Relevant degree

Tools

Terraform

Azure Cloud Services

MLflow

Job description

Vizient is seeking a senior Databricks platform engineer to design, build, and enhance the enterprise Databricks platform supporting analytics, data products, ML, and AI initiatives.

You will collaborate with Architecture, Data Engineering, Product Management, Cloud Engineering, and Data Science teams to develop reusable services and self-service capabilities that boost developer experience and productivity.