Senior Azure Data Engineer | Databricks & Synapse Lead

Valiant Technologies LLC

Pennsylvania

On-site

USD 89,000 - 126,000

Full time

25 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Valiant Technologies LLC in Malvern, PA is seeking an experienced Azure Data Engineer to design and implement scalable data pipelines. You will migrate data jobs from Synapse to Databricks, develop batch and real-time workflows, and mentor junior engineers while ensuring data quality and governance.

The role requires strong Azure data services knowledge, Spark/PySpark proficiency, and a track record of delivering reliable analytics platforms in a fast-paced environment.

Qualifications

  • 7+ years in data engineering
  • Strong expertise in Azure Databricks and Synapse
  • Proven experience with real-time streaming (Event Hubs, Kafka)
  • Deep knowledge of Azure data services (Data Lake, Data Factory, Key Vault)
  • Strong SQL and CI/CD pipeline skills
  • Excellent leadership and communication skills

Responsibilities

  • Collect, store, process and analyze large datasets to build ETL processes.
  • Lead migration of data pipelines from Synapse to Databricks.
  • Architect and implement batch and real-time data pipelines using PySpark and Databricks.
  • Mentor junior engineers and drive CI/CD automation with AzDO and Git.
  • Ensure data quality, governance and compliance (Collibra).
  • Collaborate with business/tech teams and apply insurance domain knowledge.

Job description

Valiant Technologies LLC in Malvern, PA is seeking an experienced Azure Data Engineer to design and implement scalable data pipelines. You will migrate data jobs from Synapse to Databricks, develop batch and real-time workflows, and mentor junior engineers while ensuring data quality and governance.

The role requires strong Azure data services knowledge, Spark/PySpark proficiency, and a track record of delivering reliable analytics platforms in a fast-paced environment.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Data Engineer Lead - Databricks, Synapse, PySpark
Azure Data Engineer Lead - Databricks, Synapse, PySpark

Ethereum Technologies LLC • Pennsylvania

On-site
USD 89,000 - 126,000
Azure Data Architect | Cloud Data Engineering Lead
Azure Data Architect | Cloud Data Engineering Lead

Valiant Technologies LLC • Minnesota

On-site
USD 120,000 - 150,000
Azure Data Architect | Databricks, Synapse & Power BI Expert
Azure Data Architect | Databricks, Synapse & Power BI Expert

Valiant Technologies LLC • Minnesota

On-site
USD 120,000 - 180,000
Senior Azure Databricks Data Engineer
Senior Azure Databricks Data Engineer

Valiant Technologies LLC • Houston (TX)

On-site
USD 110,000 - 160,000
Azure Data Engineer — Lead Data Pipelines & Databricks
Azure Data Engineer — Lead Data Pipelines & Databricks

Quantum Technologies LLC • Pennsylvania

On-site
USD 91,000 - 124,000
Azure Databricks Tech Lead - Remote
Azure Databricks Tech Lead - Remote

Valiant Technologies LLC • Charlotte (NC)

Remote
USD 95,000 - 136,000
Data Architect & Lead Data Engineer — Databricks & Azure
Data Architect & Lead Data Engineer — Databricks & Azure

Valiant Technologies LLC • Atlanta (GA)

On-site
USD 89,000 - 126,000
Azure Data Analytics Architect - Lead Data Solutions
Azure Data Analytics Architect - Lead Data Solutions

Valiant Technologies LLC • Houston (TX)

On-site
USD 150,000 - 200,000
Senior Azure Data Engineer: Pipelines, Databricks & SQL
Senior Azure Data Engineer: Pipelines, Databricks & SQL

Valiant Technologies LLC • Houston (TX)

On-site
USD 120,000 - 170,000
Azure Data Engineer Lead | Databricks & PySpark
Azure Data Engineer Lead | Databricks & PySpark

Robotics Technologies • Malvern

On-site
USD 89,000 - 126,000