Director, Data Platform & Databricks Engineering

Vaco Recruiter Services; Brandon (FL); On-site; USD 180,000 - 240,000; Full time

Job summary

Vaco Recruiter Services seeks a Director of Data Engineering & Platform to lead the enterprise data platform, owning Databricks environments and delivery processes. This role reports to the VP of Enterprise Data Platforms and manages approximately 10 data engineers across multiple Databricks workspaces.

The director will ensure reliability, performance, and scalable data pipelines, driving architectural standards and platform excellence in a fast-paced enterprise setting.

Qualifications

• Deep Databricks experience and production-grade data engineering background.
• Begin/lead engineering teams delivering enterprise data platforms.
• Strong hands-on with Python, SQL, Spark, and Delta Lake in production.
• Experience managing data pipelines across multiple Databricks environments/workspaces.
• Proven leadership in Agile/Scrum and Azure DevOps ecosystems.

Responsibilities

• Lead and manage ~10 data engineers building and operating the enterprise data platform.
• Set engineering standards for pipelines, testing, deployment, monitoring, and docs.
• Provide mentorship and develop future technical leaders within the team.
• Guide design reviews, challenge architectures, and troubleshoot complex platform issues.
• Own Agile/Scrum delivery process and sprint execution across the data platform.

Skills

Databricks

Python

SQL

Spark/PySpark

Agile/Scrum

Tools

Azure DevOps

Delta Lake

Unity Catalog

Databricks Workflows

MLflow

Job description

Vaco Recruiter Services seeks a Director of Data Engineering & Platform to lead the enterprise data platform, owning Databricks environments and delivery processes. This role reports to the VP of Enterprise Data Platforms and manages approximately 10 data engineers across multiple Databricks workspaces.

The director will ensure reliability, performance, and scalable data pipelines, driving architectural standards and platform excellence in a fast-paced enterprise setting.