Azure Data Engineer Lead | Databricks & PySpark

Robotics Technologies

Malvern (Chester County)

On-site

USD 89,000 - 126,000

Full time

10 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Robotics Technologies LLC in Malvern, PA is seeking an Azure Data Engineer to lead large-scale data initiatives. You will architect ETL pipelines, migrate data flows to Databricks, and deliver real-time and batch data solutions using PySpark and Event Hubs.

The role requires strong SQL, data quality focus, and hands-on leadership to mentor engineers across a global team. 12-month engagement with potential extension.

Qualifications

  • Leadership and mentoring of junior engineers.
  • Excellent written and verbal communication skills.
  • Strong SQL and data quality focus.
  • CI/CD and DevOps practices experience.
  • Ability to work with cross-functional teams.

Responsibilities

  • Collect, store, process and analyze large datasets to build ETL pipelines.
  • Lead migration of data pipelines from Synapse to Databricks.
  • Architect batch and real-time data pipelines using PySpark, Databricks and Event Hubs.
  • Establish data engineering best practices and mentor junior engineers.
  • Drive CI/CD with AzDO and Git.
  • Ensure data quality, governance and compliance (Collibra).
  • Collaborate with business/tech teams and apply insurance domain knowledge.

Job description

Robotics Technologies LLC in Malvern, PA is seeking an Azure Data Engineer to lead large-scale data initiatives. You will architect ETL pipelines, migrate data flows to Databricks, and deliver real-time and batch data solutions using PySpark and Event Hubs.

The role requires strong SQL, data quality focus, and hands-on leadership to mentor engineers across a global team. 12-month engagement with potential extension.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Data Engineer Lead - Databricks, Synapse, PySpark
Azure Data Engineer Lead - Databricks, Synapse, PySpark

Ethereum Technologies LLC • Pennsylvania

On-site
USD 89,000 - 126,000
Lead Azure Data Engineer - Databricks & ETL Specialist
Lead Azure Data Engineer - Databricks & ETL Specialist

Robotic Process Automation LLC • Pennsylvania

On-site
USD 89,000 - 126,000
Azure Data Engineer — Lead Data Pipelines & Databricks
Azure Data Engineer — Lead Data Pipelines & Databricks

Quantum Technologies LLC • Pennsylvania

On-site
USD 91,000 - 124,000
Data Engineer — Databricks & Azure ETL Specialist
Data Engineer — Databricks & Azure ETL Specialist

Robotics Technologies LLC • Plano (TX)

On-site
USD 96,000 - 152,000
Azure Data Engineer
Azure Data Engineer

Signature IT World Inc • New Jersey

Hybrid
USD 110,000 - 150,000
Lead Azure Databricks Engineer – Data Pipelines & Governance
Lead Azure Databricks Engineer – Data Pipelines & Governance

Robotics Technologies • Cincinnati (OH)

On-site
USD 91,000 - 124,000
Azure Data Engineer
Azure Data Engineer

Signature IT World Inc • Pennsylvania

Hybrid
USD 120,000 - 150,000
Azure Data Analytics Architect: Lead Databricks Solutions
Azure Data Analytics Architect: Lead Databricks Solutions

Robotic Technologies Automation • Houston (TX)

On-site
USD 130,000 - 190,000
Azure Databricks Tech Lead
Azure Databricks Tech Lead

Robotics Technologies • Charlotte (NC)

On-site
USD 140,000 - 170,000
Azure Data Engineer - Cloud Analytics & DevOps
Azure Data Engineer - Cloud Analytics & DevOps

Robotics Technologies LLC • Sunnyvale (CA)

On-site
USD 74,000 - 105,000