Remote Senior Databricks Lakehouse Migration Engineer

EmergencyMD; Washington (District of Columbia); On-site; USD 120,000 - 180,000; Full time

Benefits offered by this job

Open PTO

Federal Holidays

Health Insurance

401k Plan

Employee Recognition

Job summary

Dexian Government Solutions is seeking a Sr. Databricks Migration Engineer to support a USPSOIG contract. This role focuses on migrating from legacy SQL Server and ADF to a Databricks Lakehouse, with emphasis on scalable architectures and governance.

You will design ETL/ELT pipelines, optimize for high-concurrency Power BI queries, and lead a cross-functional team through a Spark-centric paradigm while delivering comprehensive technical docs.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related technical field.
• 5+ years data engineering or related roles.
• 5+ years with cloud platforms (Azure, AWS, GCP).
• 1+ year leading complex, cross-functional data projects and technical teams.
• Experience with Databricks Lakehouse and Spark.
• Background check required for Public Trust.

Responsibilities

• Lead migration from legacy SQL Server procedures and ADF to Databricks Lakehouse.
• Design scalable Lakehouse frameworks (Bronze/Silver/Gold).
• Develop ETL/ELT frameworks using PySpark, DLT, and Databricks.
• Optimize Databricks SQL Warehouses for Power BI DirectQuery/Import.
• Create governance for cluster sizing, auto-scaling, and serverless compute.
• Produce architecture docs and optimization playbooks.

Skills

Databricks Lakehouse

PySpark

Delta Lake

Power BI

RBAC

SQL

Data governance

Education

Bachelor's degree in CS/Engineering

Tools

Databricks Workflows

Delta Live Tables

Unity Catalog

Azure AD RBAC

Azure

Job description

Dexian Government Solutions is seeking a Sr. Databricks Migration Engineer to support a USPSOIG contract. This role focuses on migrating from legacy SQL Server and ADF to a Databricks Lakehouse, with emphasis on scalable architectures and governance.

You will design ETL/ELT pipelines, optimize for high-concurrency Power BI queries, and lead a cross-functional team through a Spark-centric paradigm while delivering comprehensive technical docs.