Senior Databricks Lakehouse Migration Lead

MDW Associates, LLC

Arlington (VA)

On-site

USD 130,000 - 155,000

Full time

14 days+

Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Health insurance

Dental

Vision

Group Life Insurance/Long Term/Short

Job summary

MDW Associates is seeking a Senior Databricks Migration Engineer to lead data migration from legacy SQL systems to Databricks Lakehouse for the USPS OIG. You will design scalable Lakehouse architectures, build ETL/ELT pipelines, and optimize for Power BI performance.

This on-site role requires strong leadership in cross-functional teams and a focus on governance and cost optimization. Applicants should have 5+ years in data engineering with cloud experience (Azure/AWS/GCP) and hands-on

Qualifications

5+ years' data engineering or related experience.
to be replaced by correct text
5+ years' cloud platform experience (Azure, AWS, GCP).
1+ year leading cross-functional data projects.
Experience with Databricks Lakehouse, Apache Spark, Delta Lake and cloud-native databases.

Responsibilities

Lead migration from legacy SQL Server to Databricks Lakehouse (Delta Lake).
Translate warehousing paradigms into scalable Lakehouse frameworks (Bronze-Silver-Gold).
Design robust ETL/ELT with PySpark, Delta Live Tables and Databricks Workflows.
Architect Gold Layer models to maximize Power BI performance.
Optimize Databricks SQL Warehouses for high-concurrency Power BI queries.
Implement governance with Unity Catalog and RBAC for security.
Create documentation, diagrams, and a knowledge transfer plan.