Senior Databricks Lakehouse Migration Lead (Remote)

LinTech Global, a Dexian company; Washington (District of Columbia); On-site; USD 145,000 - 165,000; Full time

Benefits offered by this job

Health Insurance

401k Plan

Open Paid Time Off

Job summary

Dexian Government Solutions seeks a Sr. Databricks Migration Engineer to support the USPSOIG contract in Arlington, VA, with a 100% remote work model. You will migrate from legacy SQL Server and ADF to Databricks Lakehouse, design scalable ETL/ELT pipelines, and optimize for Power BI performance.

The role requires leadership of cross-functional teams, strong data modeling skills, and deep experience with PySpark, Delta Lake, and Unity Catalog for centralized governance.

Qualifications

• Bachelor's degree or higher in Computer Science, Engineering, or a related technical field.
• 5+ years' experience in data engineering, data system development or related roles.
• 5+ years' experience with cloud platforms (Azure, AWS, GCP).
• 1+ year leading complex, cross-functional data projects and technical teams.
• Experience with Databricks Lakehouse, Apache Spark, Delta Lake, cloud-native databases and distributed compute platforms.

Responsibilities

• Lead the technical migration from legacy SQL Server and ADF pipelines to Databricks Lakehouse (Delta Lake).
• Design robust ETL/ELT frameworks using PySpark, Delta Live Tables, and Databricks Workflows.
• Architect the Gold Layer (dimensional models) to maximize Power BI performance.
• Optimize Databricks SQL Warehouses for high-concurrency Power BI queries.
• Define governance for cluster sizing, auto-scaling, and serverless compute.
• Establish security with Unity Catalog and enforce row- and column-level security.
• Create comprehensive technical documentation and knowledge transfer plans.

Skills

Analytical thinking

Leadership

Pair programming

Communication

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

Databricks Lakehouse

Delta Lake

PySpark

Delta Live Tables

Databricks Workflows

Job description

Dexian Government Solutions seeks a Sr. Databricks Migration Engineer to support the USPSOIG contract in Arlington, VA, with a 100% remote work model. You will migrate from legacy SQL Server and ADF to Databricks Lakehouse, design scalable ETL/ELT pipelines, and optimize for Power BI performance.

The role requires leadership of cross-functional teams, strong data modeling skills, and deep experience with PySpark, Delta Lake, and Unity Catalog for centralized governance.