Lead Azure Data Engineer - Databricks & ETL Specialist

Robotic Process Automation LLC

Pennsylvania

On-site

USD 89,000 - 126,000

Full time

26 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Robotic Technologies Automation is seeking an experienced Azure Data Engineer in Malvern, PA to lead the design and migration of data pipelines. The role focuses on building scalable ETL/ELT processes, real-time and batch analytics, and governance with Collibra.

You will work with Spark, PySpark, Databricks, Event Hubs, and Azure data services to deliver robust data platforms. Strong leadership and CI/CD experience are essential.

Qualifications

  • 7+ years in data engineering or related field
  • Experience leading data engineering teams
  • Strong Azure data services experience
  • Migration of data pipelines from one platform to another
  • Hands-on with real-time streaming and batch data processing
  • Proven ability to implement CI/CD for data pipelines
  • Excellent communication and leadership skills

Responsibilities

  • Lead design and implementation of ETL/ELT pipelines
  • Migrate data pipelines from Synapse to Databricks
  • Develop batch and real-time data pipelines using PySpark and Event Hubs
  • Establish data engineering best practices and mentor junior engineers
  • Drive CI/CD automation with AzDO and Git
  • Ensure data quality, governance and compliance (Collibra)
  • Collaborate with business and tech teams across locations
  • Develop reusable data frameworks to reduce development effort

Skills

Leadership
CI/CD
SQL
Spark
Python
Data Warehouses
ETL
Azure

Tools

Azure Databricks
Synapse
PySpark
Event Hubs
Cosmos DB
HDFS

Job description

Robotic Technologies Automation is seeking an experienced Azure Data Engineer in Malvern, PA to lead the design and migration of data pipelines. The role focuses on building scalable ETL/ELT processes, real-time and batch analytics, and governance with Collibra.

You will work with Spark, PySpark, Databricks, Event Hubs, and Azure data services to deliver robust data platforms. Strong leadership and CI/CD experience are essential.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Data Engineer Lead | Databricks & PySpark
Azure Data Engineer Lead | Databricks & PySpark

Robotics Technologies • Malvern

On-site
USD 89,000 - 126,000
Azure Databricks Migration Engineer (ETL to ELT)
Azure Databricks Migration Engineer (ETL to ELT)

Robotic Technologies Automation • Wilmington (DE)

On-site
USD 120,000 - 160,000
Azure Data Engineer — Databricks & ADF ETL Expert
Azure Data Engineer — Databricks & ADF ETL Expert

Robotic Process Automation LLC • Richardson (TX)

On-site
USD 98,000 - 139,000
Data Engineer: Databricks & ADF ETL Specialist
Data Engineer: Databricks & ADF ETL Specialist

Robotic Process Automation LLC • Irving (TX)

On-site
USD 98,000 - 139,000
Data Engineer: Databricks & ADF ETL Specialist
Data Engineer: Databricks & ADF ETL Specialist

Robotic Process Automation LLC • Dallas (TX)

On-site
USD 89,000 - 126,000
Data Engineer: Databricks & Azure Data Factory
Data Engineer: Databricks & Azure Data Factory

Robotic Process Automation LLC • Fort Wayne (IN)

On-site
USD 98,000 - 139,000
Data Engineer — Databricks & Azure ETL Specialist
Data Engineer — Databricks & Azure ETL Specialist

Robotics Technologies LLC • Plano (TX)

On-site
USD 96,000 - 152,000
Azure Data Engineer Lead - Databricks, Synapse, PySpark
Azure Data Engineer Lead - Databricks, Synapse, PySpark

Ethereum Technologies LLC • Pennsylvania

On-site
USD 89,000 - 126,000
Senior Databricks Engineer for Enterprise Data Pipelines
Senior Databricks Engineer for Enterprise Data Pipelines

Robotic Process Automation LLC • Pennsylvania

On-site
USD 95,000 - 128,000
Azure Data Engineer Lead: Pipelines, Databricks & Delta Lake
Azure Data Engineer Lead: Pipelines, Databricks & Delta Lake

Robotic Process Automation LLC • Houston (TX)

On-site
USD 120,000 - 170,000