Azure Databricks Migration Engineer - ETL Modernization

Ethereum Technologies; Wilmington (DE); On-site; USD 140,000 - 190,000; Full time

Job summary

Ethereum Technologies is seeking a highly skilled data engineering leader to migrate data pipelines from Informatica to Azure Databricks. You will assess current assets, define the target architecture, and drive a phased migration plan with strong collaboration across business, product, and operations teams.

You will modernize ETL patterns into scalable ELT approaches using PySpark, Python, and Spark SQL, mentoring engineers and ensuring production readiness and data quality throughout the

Qualifications

• Experience leading end-to-end data migration projects.
• Ability to translate source/target mappings into scalable PySpark pipelines.
• Strong collaboration with业务 stakeholders to align migration objectives.

Responsibilities

• Lead the end-to-end migration of data pipelines from Informatica to Azure Databricks.
• Assess current Informatica assets and define target architecture, strategy, and phased plans.
• Drive ELT modernization using Databricks best practices and PySpark-based pipelines.
• Analyze Informatica mappings and convert to PySpark, Python, or Spark SQL equivalents.
• Provide technical leadership across design, standards, testing, and deployment.
• Mentor engineers on Databricks patterns and modern data engineering practices.

Skills

PySpark

Python

SQL

Tools

Informatica PowerCenter

Azure Databricks

Spark SQL

Job description

Ethereum Technologies is seeking a highly skilled data engineering leader to migrate data pipelines from Informatica to Azure Databricks. You will assess current assets, define the target architecture, and drive a phased migration plan with strong collaboration across business, product, and operations teams.

You will modernize ETL patterns into scalable ELT approaches using PySpark, Python, and Spark SQL, mentoring engineers and ensuring production readiness and data quality throughout the