Senior Databricks Data Engineer and Lakehouse Architect

Celebal Technologies

Grand Rapids (MI)

Hybrid

USD 140,000 - 190,000

Full time

2 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Celebal Technologies is seeking a Lead Data Engineer (Databricks) to architect, build, and operate scalable data lakehouse solutions on Databricks across Azure or AWS in a hybrid setup in Grand Rapids, MI.

This is a hands-on technical leadership role responsible for end-to-end platform design, end-to-end delivery, and guiding data engineering teams.

Key focus areas include Medallion Architecture, Delta Lake, and optimized Spark workloads, with Databricks certification preferred.

Qualifications

  • Databricks architecture and Lakehouse design experience.
  • Hands-on Medallion Architecture and Databricks Auto Loader.
  • Strong SQL, PySpark and Python skills.
  • Experience with Azure Databricks or AWS Databricks.
  • Knowledge of Spark, Delta Lake and ETL/ELT design.
  • Proven pipeline optimization and production-grade data engineering experience.
  • Knowledge of data governance, security and scalable architecture design.
  • Strong communication, analytical, and problem-solving skills.

Responsibilities

  • Design and implement enterprise-scale Databricks architectures using Medallion Architecture (Bronze, Silver, Gold).
  • Develop ETL/ELT pipelines using SQL, PySpark, and Python.
  • Build incremental and streaming ingestion pipelines with Databricks Auto Loader.
  • Implement Delta Lake solutions for reliable, ACID-compliant storage and processing.
  • Integrate Databricks with Azure or AWS cloud services.
  • Optimize Apache Spark workloads, SQL queries, cluster configurations, and pipeline performance.
  • Establish data governance, security, and access control standards.
  • Provide technical leadership and architectural guidance to data engineering teams.
  • Support production deployments, troubleshooting, and performance tuning.

Skills

Databricks architecture
Medallion Architecture
SQL
PySpark
Python
Azure Databricks
AWS Databricks
Spark
Delta Lake
ETL/ELT design
pipeline optimization
data governance
security
communication skills

Job description

Celebal Technologies is seeking a Lead Data Engineer (Databricks) to architect, build, and operate scalable data lakehouse solutions on Databricks across Azure or AWS in a hybrid setup in Grand Rapids, MI.

This is a hands-on technical leadership role responsible for end-to-end platform design, end-to-end delivery, and guiding data engineering teams.

Key focus areas include Medallion Architecture, Delta Lake, and optimized Spark workloads, with Databricks certification preferred.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Data Engineer (Databricks)
Lead Data Engineer (Databricks)

Celebal Technologies • Grand Rapids (MI)

Hybrid
USD 140,000 - 190,000
Senior Databricks Data Architect & Lakehouse Lead
Senior Databricks Data Architect & Lakehouse Lead

Celebal Technologies • United States

On-site
USD 180,000 - 240,000
Lead Databricks Lakehouse Architect (Remote)
Lead Databricks Lakehouse Architect (Remote)

Celebal Technologies • United States

Remote
USD 140,000 - 210,000
Career development
Cutting-edge Databricks tech exposure
Global collaboration
Senior Databricks Architect - AWS Lakehouse Leader
Senior Databricks Architect - AWS Lakehouse Leader

Valiant Technologies LLC • Atlanta (GA)

On-site
USD 170,000 - 210,000
Data Engineering Manager: Lakehouse & Databricks Lead
Data Engineering Manager: Lakehouse & Databricks Lead

Ledgent Technology • San Diego (CA)

On-site
USD 162,000 - 198,000
Senior Databricks Lakehouse Engineer - Data Platform Lead
Senior Databricks Lakehouse Engineer - Data Platform Lead

ExlService Holdings, Inc. • New York (NY)

On-site
USD 170,000 - 230,000
Remote Databricks Lakehouse Architect Lead
Remote Databricks Lakehouse Architect Lead

NewVision Software • United States

Remote
USD 120,000 - 180,000
Senior Data Engineer - Databricks Lakehouse Architect
Senior Data Engineer - Databricks Lakehouse Architect

UNAVAILABLE • McLean (VA)

On-site
USD 120,000 - 160,000
Lead Databricks Engineer
Lead Databricks Engineer

Programmers • Minneapolis (MN)

On-site
USD 120,000 - 170,000
Databricks Data Architect Lead — Lakehouse & Cloud
Databricks Data Architect Lead — Lakehouse & Cloud

MatrixEdge Inc • Kansas City (MO)

On-site
USD 150,000 - 190,000