Azure Data Engineer Lead - Databricks, Synapse, PySpark

Ethereum Technologies LLC

Pennsylvania

On-site

USD 89,000 - 126,000

Full time

26 hours ago
Be an early applicant

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Ethereum Technologies in Malvern, PA is seeking an experienced Azure Data Engineer for a 12-month contract to design and implement large-scale data pipelines using Databricks, Synapse, PySpark and Event Hubs.

Your responsibilities include migrating data pipelines, building batch and real-time ETL, establishing best practices, driving CI/CD with AzDO, and mentoring junior engineers while ensuring data quality, governance and compliance.

Qualifications

  • 7+ years in data engineering, 3+ in a lead/senior role.

Responsibilities

  • Collect, store, process and analyze large datasets to build and implement ETL processes.
  • Lead migration of data pipelines from Synapse to Databricks.
  • Architect and implement batch + real-time data pipelines using PySpark, Databricks, and Event Hubs.
  • Establish data engineering best practices and mentor junior engineers.
  • Drive CI/CD automation with AzDO and Git.
  • Ensure data quality, governance, and compliance (Collibra).
  • Collaborate with business/tech teams; leverage insurance domain knowledge where applicable.

Skills

Azure Databricks
Synapse
PySpark
Event Hubs
CI/CD
AzDO
Data governance
Mentoring

Tools

Databricks
Azure Data Factory
HDInsight
Hive
Kafka
Cosmos DB
Delta Lake

Job description

Ethereum Technologies in Malvern, PA is seeking an experienced Azure Data Engineer for a 12-month contract to design and implement large-scale data pipelines using Databricks, Synapse, PySpark and Event Hubs.

Your responsibilities include migrating data pipelines, building batch and real-time ETL, establishing best practices, driving CI/CD with AzDO, and mentoring junior engineers while ensuring data quality, governance and compliance.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Data Engineer Lead | Databricks & PySpark
Azure Data Engineer Lead | Databricks & PySpark

Robotics Technologies • Malvern

On-site
USD 89,000 - 126,000
Azure Data Engineer — Lead Data Pipelines & Databricks
Azure Data Engineer — Lead Data Pipelines & Databricks

Quantum Technologies LLC • Pennsylvania

On-site
USD 91,000 - 124,000
Senior Azure Data Engineer | Databricks & Synapse Lead
Senior Azure Data Engineer | Databricks & Synapse Lead

Valiant Technologies LLC • Pennsylvania

On-site
USD 89,000 - 126,000
Azure Data Engineer
Azure Data Engineer

Signature IT World Inc • New Jersey

Hybrid
USD 110,000 - 150,000
Azure Data Engineer
Azure Data Engineer

Signature IT World Inc • Pennsylvania

Hybrid
USD 120,000 - 150,000
Senior Databricks Engineer — Cloud Data Platform Lead
Senior Databricks Engineer — Cloud Data Platform Lead

Ethereum Technologies LLC • Pennsylvania

On-site
USD 112,000 - 128,000
Azure Data Engineer: Pipelines, Lakehouse & Synapse
Azure Data Engineer: Pipelines, Lakehouse & Synapse

Ethereum Technologies LLC • Raleigh (NC)

On-site
USD 120,000 - 150,000
None
Lead Azure Data Engineer - Databricks & ETL Specialist
Lead Azure Data Engineer - Databricks & ETL Specialist

Robotic Process Automation LLC • Pennsylvania

On-site
USD 89,000 - 126,000
Azure Databricks Engineer
Azure Databricks Engineer

IQuest Solutions Corporation • Newtown Square

On-site
USD 120,000 - 170,000
Azure Data Architect: Databricks, Synapse & Power BI
Azure Data Architect: Databricks, Synapse & Power BI

Ethereum Technologies LLC • Minnesota

On-site
USD 120,000 - 160,000