Lead Software Engineer (Databricks Platform Engineer)

Vizient; Edina (MN); On-site; USD 118,000 - 206,000; Full time

Job summary

Vizient seeks a senior professional to lead the design, implementation, and evolution of its enterprise Databricks platform, enabling analytics, data products, ML, and AI solutions across the organization.

You will develop reusable services, automation frameworks, and self-service capabilities, ensuring scalable, secure, and cost-efficient cloud deployments. Collaboration across EA, Data Eng, PM, Cloud Eng, and Data Science teams is essential.

Qualifications

• Advanced degree preferred; relevant degree required/strongly preferred.
• 7+ years of relevant experience required.
• 3+ years designing, implementing, and supporting Databricks platform solutions required.
• Strong experience with Azure cloud services and enterprise platform engineering required.
• Experience with Terraform, IaC, CI/CD pipelines, and infrastructure automation.
• Knowledge of Delta Lake, Unity Catalog, Spark, and lakehouse architectures.
• Experience developing reusable platform services, automation frameworks, and engineering accelerators.
• Experience supporting ML/AI platform capabilities including MLflow, Model Registry, Feature Store, Vector Search, or MLOps preferred.
• Databricks certification and healthcare industry experience preferred.

Responsibilities

• Lead design, implementation, and evolution of the enterprise Databricks platform and architecture.
• Develop reusable platform services, reference architectures, and engineering standards for analytics, data products, and AI workloads.
• Build IaC, CI/CD pipelines, and automation to improve scalability and reliability.
• Create self-service capabilities, templates, and accelerators for faster onboarding.
• Optimize platform performance, security, governance, and cost across clouds.
• Enable ML/AI platform capabilities with patterns for MLflow, Model Registry, Feature Store, Vector Search.
• Collaborate with EA, Data Eng, PM, Cloud Eng, Data Science, and stakeholders to deliver platform capabilities.
• Evaluate features, run proof-of-concepts, guide platform enhancements for business objectives.
• Provide technical leadership, mentoring, and Platform-as-a-Product practices.
• Drive continuous improvement through automation and adoption of standards.

Skills

Databricks platform

Azure cloud

Terraform / IaC

CI/CD pipelines

Delta Lake / Unity Catalog / Spark

Platform engineering

MLflow / MLOps

Self-service platforms

Automation

Healthcare domain experience

Education

Advanced degree in Computer Science, Engineering, Information Systems, or related field

Tools

Databricks

Terraform

Unity Catalog

Apache Spark

MLflow

Job description

When you’re the best, we’re the best. We instill an environment where employees feel engaged, satisfied and able to contribute their unique skills and talents while living and working as their authentic selves. We provide extensive opportunities for personal and professional development, building both employee competence and organizational capability to fuel exceptional performance through an inclusive environment both now and in the future.

Summary

In this role, you will lead the design, engineering, and evolution of the enterprise Databricks platform as a strategic capability that enables analytics, data products, machine learning, and AI solutions across the organization. You will develop reusable platform services, automation frameworks, reference architectures, and self-service capabilities that accelerate delivery while aligning with enterprise architecture, governance, and engineering standards. You will collaborate with cross-functional teams to enhance developer experience, drive platform adoption, evaluate emerging technologies, and deliver scalable, secure, and cost-effective healthcare data and AI solutions.

Responsibilities

• Lead the design, implementation, and continuous evolution of the enterprise Databricks platform and supporting architecture.
• Develop reusable platform services, reference architectures, engineering standards, and implementation patterns for analytics, data products, streaming, and AI workloads.
• Build Infrastructure-as-Code, CI/CD pipelines, and automation frameworks to improve platform scalability, reliability, and operational efficiency.
• Create self-service capabilities, reusable templates, and engineering accelerators that simplify platform onboarding and deployment.
• Optimize platform performance, scalability, security, governance, and cost efficiency across cloud environments.
• Enable machine learning and AI platform capabilities by implementing patterns for MLflow, Model Registry, Feature Store, Vector Search, and other Databricks technologies.
• Partner with Enterprise Architecture, Data Engineering, Product Management, Cloud Engineering, Data Science, and client stakeholders to deliver enterprise platform capabilities.
• Evaluate emerging Databricks features and cloud technologies, lead proof-of-concepts, and recommend platform enhancements that support business objectives.
• Provide technical leadership, mentoring, and engineering guidance while promoting Platform-as-a-Product principles and engineering best practices.
• Drive continuous improvement through automation, innovation, and adoption of enterprise platform standards.

Qualifications

• Relevant degree preferred. Advanced degree in Computer Science, Engineering, Information Systems, or a related field preferred.
• 7 or more years of relevant experience required.
• 3 or more years of hands-on experience designing, implementing, and supporting Databricks platform solutions required.
• Strong experience with Azure cloud services, cloud-native architectures, and enterprise platform engineering required.
• Experience with Terraform, Infrastructure-as-Code, and CI/CD pipelines, and infrastructure automation.
• Strong knowledge of Delta Lake, Unity Catalog, Apache Spark, and lakehouse architectures.
• Experience developing reusable platform services, automation frameworks, self-service capabilities, and engineering accelerators.
• Experience supporting machine learning and AI platform capabilities, including MLflow, Model Registry, Feature Store, Vector Search, or MLOps practices preferred.
• Databricks certification, experience with streaming and event-driven architectures, enterprise-scale data platforms, or healthcare industry experience preferred.

Estimated Hiring Range

At Vizient, we consider skills, experience, and organizational needs in our compensation approach. Geographic factors may adjust the range estimate and hires typically fall below the top range. Compensation decisions are tailored to individual circumstances. The current salary range for this role is $117,600.00 to $206,000.00.

This position is also incentive eligible.

Vizient has a comprehensive benefits plan! Please view our benefits here: http://www.vizientinc.com/about-us/careers

Equal Opportunity Employer: Females/Minorities/Veterans/Individuals with Disabilities

The Company is committed to equal employment opportunity to all employees and applicants without regard to race, religion, color, gender identity, ethnicity, age, national origin, sexual orientation, disability status, veteran status or any other category protected by applicable law.