Databricks Platform Lead for AI, Analytics & Cloud

Vizient; Chicago (IL); On-site; USD 118,000 - 206,000; Full time

Benefits offered by this job

Comprehensive benefits plan

Job summary

Vizient is seeking a senior data platform engineer to lead the enterprise Databricks platform design and evolution. You will develop reusable services, reference architectures, and automation to accelerate analytics, data products, ML, and AI workloads.

You will collaborate with cross-functional teams to ensure scalable, secure, and cost-effective data solutions across cloud environments while promoting platform-as-a-product practices.

Qualifications

• Advanced degree in Computer Science, Engineering, Information Systems, or a related field preferred.
• 7+ years of relevant experience required.
• 3+ years of hands-on experience designing, implementing, and supporting Databricks platform solutions required.
• Strong experience with Azure cloud services, cloud-native architectures, and enterprise platform engineering required.
• Experience with Terraform, Infrastructure-as-Code, and CI/CD pipelines, and infrastructure automation.
• Strong knowledge of Delta Lake, Unity Catalog, Apache Spark, and lakehouse architectures.
• Experience developing reusable platform services, automation frameworks, self-service capabilities, and engineering accelerators.
• Experience supporting machine learning and AI platform capabilities, including MLflow, Model Registry, Feature Store, Vector Search, or MLOps practices preferred.
• Databricks certification, experience with streaming and event-driven architectures, enterprise-scale data platforms, or healthcare industry experience preferred.

Responsibilities

• Lead the design, implementation, and continuous evolution of the enterprise Databricks platform and supporting architecture.
• Develop reusable platform services, reference architectures, engineering standards, and implementation patterns for analytics, data products, streaming, and AI workloads.
• Build Infrastructure-as-Code, CI/CD pipelines, and automation frameworks to improve platform scalability, reliability, and operational efficiency.
• Create self-service capabilities, reusable templates, and engineering accelerators that simplify platform onboarding and deployment.
• Optimize platform performance, scalability, security, governance, and cost efficiency across cloud environments.
• Enable machine learning and AI platform capabilities by implementing patterns for MLflow, Model Registry, Feature Store, Vector Search, and other Databricks technologies.
• Partner with Enterprise Architecture, Data Engineering, Product Management, Cloud Engineering, Data Science, and client stakeholders to deliver enterprise platform capabilities.
• Evaluate emerging Databricks features and cloud technologies, lead proof-of-concepts, and recommend platform enhancements that support business objectives.
• Provide technical leadership, mentoring, and engineering guidance while promoting Platform-as-a-Product principles and engineering best practices.
• Drive continuous improvement through automation, innovation, and adoption of enterprise platform standards.

Education

Advanced degree in Computer Science, Engineering, Information Systems, or a related field

Relevant degree preferred

Tools

Databricks Platform

Terraform

Delta Lake

Unity Catalog

Apache Spark

MLflow

Model Registry

Feature Store

Vector Search

MLOps

Job description

Vizient is seeking a senior data platform engineer to lead the enterprise Databricks platform design and evolution. You will develop reusable services, reference architectures, and automation to accelerate analytics, data products, ML, and AI workloads.

You will collaborate with cross-functional teams to ensure scalable, secure, and cost-effective data solutions across cloud environments while promoting platform-as-a-product practices.