Azure Databricks Platform Engineer | Remote

Vanderbilt University Medical Center; United States; Remote; USD 110,000 - 150,000; Full time

Job summary

Vanderbilt University Medical Center seeks a Data Engineer / Platform Administrator to manage the Azure Databricks platform (100+ workspaces) and build scalable data pipelines. The role combines platform governance with hands-on data engineering to optimize performance, costs, and data quality.

The position offers a remote-friendly setup from most US locations, with an 80/20 mix between platform administration and data engineering responsibilities.

Qualifications

• Bachelor's degree required.
• 1+ year of experience with Databricks (certifications are a plus).
• 2+ years of Python in an object-oriented paradigm.
• 2+ years implementing cloud solutions with Azure, AWS, or GCP.
• 1+ year of SQL experience.

Responsibilities

• Platform Administration (~80%): administer Azure Databricks environment with 100+ workspaces, governance, access controls, and compute policies.
• Build automation and Infrastructure as Code to provision/manage workspaces at scale.
• Monitor platform health, performance, and costs; test new Databricks features and promote best practices.
• Data Engineering (~20%): design/develop data pipelines across multiple source systems; troubleshoot production pipelines; ensure data quality and scalability.

Skills

Databricks

Python

Cloud platforms

SQL

Education

Bachelor's degree

Tools

Terraform

CI/CD (GitLab/GitHub/Azure DevOps)

REST APIs

Docker/Podman

Job description

Vanderbilt University Medical Center seeks a Data Engineer / Platform Administrator to manage the Azure Databricks platform (100+ workspaces) and build scalable data pipelines. The role combines platform governance with hands-on data engineering to optimize performance, costs, and data quality.

The position offers a remote-friendly setup from most US locations, with an 80/20 mix between platform administration and data engineering responsibilities.