Databricks Data Platform Lead

Mega Cloud Lab; Santa Clara (CA); On-site; USD 150,000 - 190,000; Full time

Job summary

Mega Cloud Lab in Santa Clara, CA is seeking a Data Platform Lead who owns the technical direction and implementation of a secure, governed cloud data platform built on Databricks. The role combines hands-on data engineering with enterprise architecture leadership across tenant isolation and platform operations.

Responsibilities include defining target architecture, leading Databricks deployment, building data pipelines, ensuring security by design, data governance, encryption, and production

Qualifications

• Bachelor’s degree or equivalent with substantial enterprise cloud data platform leadership experience.
• Extensive hands-on Databricks, Spark, Delta Lake, Unity Catalog, SQL, and Python experience.
• Proven ability to design and operate multi-tenant data platforms with governance and security considerations.

Responsibilities

• Define target architecture and engineering standards for EPIC Databricks environments.
• Lead Databricks setup including Unity Catalog, Delta Lake, pipelines, and workloads.
• Design batch, streaming, and event-driven data ingestion and transformations.

Skills

Databricks

Apache Spark

Delta Lake

Unity Catalog

SQL

Python

Education

Bachelor's degree in Computer Science, Engineering, Information Systems, Data Science, or related field

Tools

Databricks platform

Job description

Mega Cloud Lab in Santa Clara, CA is seeking a Data Platform Lead who owns the technical direction and implementation of a secure, governed cloud data platform built on Databricks. The role combines hands-on data engineering with enterprise architecture leadership across tenant isolation and platform operations.

Responsibilities include defining target architecture, leading Databricks deployment, building data pipelines, ensuring security by design, data governance, encryption, and production