Lead Data Engineer: Databricks Lakehouse Architect (Remote)

Celebal Technologies

United States

Remote

USD 140,000 - 190,000

Full time

Just now

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Celebal Technologies is seeking a Lead Data Engineer with 10+ years of experience to lead data engineering initiatives. You will design and implement scalable data pipelines on Databricks, apply Medallion Architecture, and work across Azure or AWS to deliver enterprise-grade data solutions.

The role demands hands-on expertise with Delta Live Tables, Delta Lake, and Spark, plus mentoring of the data team. Remote work is supported with travel to client sites as needed.

Qualifications

10+ years of experience in Data Engineering, Big Data, and data platforms.
Hands-on Databricks and Lakehouse Platform expertise.
Strong design and implementation of medallion architectures (Bronze-Silver-Gold).
Experience with Delta Live Tables (DLT) and Databricks Auto Loader.
Proficient in PySpark, Python, SQL; cloud experience on Azure or AWS.

Responsibilities

Lead design, development, and deployment of scalable data pipelines using Databricks.
Implement end-to-end data pipelines with Medallion Architecture (Bronze-Silver-Gold).
Develop and optimize ingestion/ETL/ELT using DLT and Auto Loader.
Build and manage data lakehouse solutions with Delta Lake and Spark.
Define data governance, quality, and CI/CD practices; mentor engineers.

Skills

Databricks

Medallion Architecture

DLT

Auto Loader

PySpark

Python

SQL

Azure/AWS

Tools

Delta Lake

Apache Spark

Unity Catalog

Terraform

Job description

The role demands hands-on expertise with Delta Live Tables, Delta Lake, and Spark, plus mentoring of the data team. Remote work is supported with travel to client sites as needed.

Get your free, confidential resume review.

or drag and drop your file here.