Lead Databricks Platform Engineer — AI & Data Platform

Vizient, Inc.; Chicago (IL); On-site; USD 118,000 - 206,000; Full time

Job summary

Vizient, Inc. seeks an experienced leader to drive design and evolution of our enterprise Databricks platform, enabling analytics, data products, ML, and AI across the organization.

You will develop platform services, automation, and reference architectures while aligning with governance and engineering standards. You will collaborate with cross-functional teams to enhance developer experience, adopt new technologies, and deliver scalable, secure AI solutions.

Qualifications

• 7+ years of relevant experience.
• 3+ years designing, implementing, and supporting Databricks platform solutions.
• Strong experience with Azure cloud services and enterprise platform engineering.
• Knowledge of Delta Lake, Unity Catalog, Apache Spark and lakehouse architectures.

Responsibilities

• Lead the design, implementation, and evolution of the enterprise Databricks platform and supporting architecture.
• Develop reusable platform services, reference architectures, engineering standards, and implementation patterns.
• Build IaC, CI/CD pipelines, and automation frameworks to improve scalability and reliability.
• Create self-service capabilities, templates, and accelerators to simplify onboarding and deployment.
• Optimize performance, security, governance, and cost efficiency across cloud environments.
• Enable ML/AI capabilities with patterns for MLflow, Model Registry, Feature Store, Vector Search.
• Partner with EA, Data Eng, Product Mgmt, Cloud Eng, Data Science, and stakeholders to deliver platform capabilities.
• Evaluate emerging Databricks features and cloud tech; lead POCs and recommend enhancements.
• Provide technical leadership, mentoring, and Platform-as-a-Product governance.

Skills

Databricks platform

Azure cloud services

CI/CD pipelines

Engineering accelerators

MLOps concepts

Delta Lake

Unity Catalog

Apache Spark

Platform engineering

Education

Advanced degree in Computer Science, Engineering, Information Systems, or related field

Tools

Terraform

Job description

Vizient, Inc. seeks an experienced leader to drive design and evolution of our enterprise Databricks platform, enabling analytics, data products, ML, and AI across the organization.

You will develop platform services, automation, and reference architectures while aligning with governance and engineering standards. You will collaborate with cross-functional teams to enhance developer experience, adopt new technologies, and deliver scalable, secure AI solutions.