Senior Databricks Migration Architect — Remote

Lumenalta

United States

Remote

USD 80,000 - 120,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Health insurance
401K Contribution
Paid time off
Professional development fund

Job summary

Lumenalta is seeking a Data Architect/Databricks Migration Data Engineer to lead a large-scale Azure Databricks migration. You will design medallion architecture, define patterns, and guide cross-functional teams through lift-and-shift to a lakehouse.

This fully remote US-based role requires 7+ years as a data engineer, hands-on Python, PySpark, SQL, and production experience with Databricks on Azure. You will mentor engineers and deliver scalable pipelines and dashboards.

Qualifications

  • 7+ years as a Data Engineer, including time as a technical lead or data architect on a data platform team.
  • Production experience with Databricks on Azure.
  • Strong hands-on experience with Python, PySpark, and advanced SQL.
  • Proven experience designing medallion architectures in production.
  • Experience migrating production workloads to a modern lakehouse from Dataiku or Hadoop-based platforms.
  • Experience with streaming or event-driven ingestion on Azure (Event Hubs/Grid/Explorer) and Spark Structured Streaming.

Responsibilities

  • Guide the overall solution design for the platform with the client's project lead.
  • Define Databricks patterns and standards (medallion architecture, pipeline conventions).
  • Lead the migration of production pipelines from Dataiku/Cloudera to Databricks across silver and gold layers.
  • Maintain production outputs during transition via parallel runs and safe cutover.
  • Evaluate and design real-time ingestion from Azure services into Databricks, including Spark Structured Streaming.
  • Support migration of Power BI dashboards to Databricks dashboards.
  • Mentor engineers and ensure long-term platform ownership.

Skills

Python
PySpark
Advanced SQL
Databricks on Azure

Tools

Databricks
Azure Databricks

Job description

Lumenalta is seeking a Data Architect/Databricks Migration Data Engineer to lead a large-scale Azure Databricks migration. You will design medallion architecture, define patterns, and guide cross-functional teams through lift-and-shift to a lakehouse.

This fully remote US-based role requires 7+ years as a data engineer, hands-on Python, PySpark, SQL, and production experience with Databricks on Azure. You will mentor engineers and deliver scalable pipelines and dashboards.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Azure Databricks Platform Architect (Remote)
Senior Azure Databricks Platform Architect (Remote)

Lumenalta • United States

Remote
USD 80,000 - 150,000
Health insurance
401K Contribution
Professional development fund
+1
Senior Databricks Data Platform Engineer (Remote)
Senior Databricks Data Platform Engineer (Remote)

Lumenalta • United States

Remote
USD 80,000 - 150,000
Health insurance (medical)
401K Contribution
Paid time off
Azure Databricks Data Migration Lead | Solution Architect
Azure Databricks Data Migration Lead | Solution Architect

Celebal Technologies • Grand Rapids (MI)

On-site
USD 120,000 - 180,000
Senior Databricks Architect – Remote Data Lakehouse Leader
Senior Databricks Architect – Remote Data Lakehouse Leader

Cognizant Technology Solutions Corporation • Olympia (WA)

Remote
USD 160,000 - 210,000
Remote Senior Databricks Data Engineer, ERP & Logistics
Remote Senior Databricks Data Engineer, ERP & Logistics

Lumenalta • United States

Remote
USD 90,000 - 132,000
Health insurance
401K Contribution
Professional development fund
+2
Remote Tech Lead, Data Engineering (Databricks)
Remote Tech Lead, Data Engineering (Databricks)

Lumenalta • United States

Remote
MXN 2,047,000 - 2,792,000
Solutions Architect - Databricks (Remote)
Solutions Architect - Databricks (Remote)

Lumenalta • Dallas (TX)

Remote
USD 75,000 - 140,000
Flexible working hours
Health insurance
401K Contribution
+3
Lead Databricks Lakehouse Architect (Remote)
Lead Databricks Lakehouse Architect (Remote)

Celebal Technologies • United States

Remote
USD 140,000 - 210,000
Career development
Cutting-edge Databricks tech exposure
Global collaboration
Senior Databricks Data Engineer - Remote Platform Builder
Senior Databricks Data Engineer - Remote Platform Builder

Lumenalta • United States

Remote
USD 90,000 - 132,000
Health insurance
401K Contribution
Professional development fund
+1
Azure Databricks Data Architect - Lead Lakehouse Solutions
Azure Databricks Data Architect - Lead Lakehouse Solutions

Ascendum Solutions • Cincinnati (OH)

On-site
USD 140,000 - 170,000