Azure Databricks Migration Lead - ELT Data Platform

Quantum Technologies. LLC; Wilmington (DE); On-site; USD 140,000 - 190,000; Full time

Job summary

Quantum Technologies. LLC is seeking a senior data engineering lead to orchestrate the migration from Informatica PowerCenter to Azure Databricks.

You will design target state architecture, define migration strategies, and guide phased execution with a focus on ELT and scalable data pipelines. You will mentor engineers, collaborate with business and security teams, establish migration success criteria, and ensure production readiness and observability.

Qualifications

• Experience leading end-to-end migration from Informatica PowerCenter to Databricks.
• Define target architecture, migration strategy, and phased execution plans.
• Strong leadership across design, engineering standards, testing, and production readiness.

Responsibilities

• Lead end-to-end migration of data pipelines, workflows, and integration patterns to Azure Databricks.
• Assess Informatica assets, define target state architecture and phased execution plans.
• Modernize ETL to scalable ELT and data engineering patterns with Databricks best practices.
• Mentor engineers on Databricks design patterns and reusable frameworks.

Skills

Data migration

Data engineering

PySpark

Solution architecture

Tools

Azure Databricks

Unity Catalog

Delta Live Tables

ADLS Gen2

Oracle

PySpark

Spark SQL

Python

Job description

Quantum Technologies. LLC is seeking a senior data engineering lead to orchestrate the migration from Informatica PowerCenter to Azure Databricks.

You will design target state architecture, define migration strategies, and guide phased execution with a focus on ELT and scalable data pipelines. You will mentor engineers, collaborate with business and security teams, establish migration success criteria, and ensure production readiness and observability.