Senior Data Engineer: Azure Databricks & Streaming

Brightwater Recruitment; Dublin; Hybrid; EUR 60,000 - 110,000; Full time

Job summary

Brightwater Recruitment partners with a growing HealthTech company to hire a Senior Data Engineer on a 12-month contract in Dublin. The role is hands-on, delivering scalable data pipelines on the Azure data platform and collaborating with engineering leads across Ireland and the US.

The position requires 6+ years in data engineering, strong Azure Databricks and PySpark skills, and experience with Data Lake, ADF, Kafka or Event Hub, SQL and Python.

Qualifications

• 6+ years of experience in Data Engineering.
• Strong Azure Databricks and PySpark experience.
• Azure Data Lake and ADF/orchestration tools.
• SQL and Python proficiency.
• Event-based or streaming ingestion using Event Hub, Kafka, or similar.
• Strong knowledge of ETL/ELT, data modelling, and distributed data processing.
• Experience working with production-grade data platforms.

Responsibilities

• Hands-on delivery role focused on building and improving scalable data pipelines across the Azure data platform.
• Collaborate with engineering leads and wider teams in Ireland and the US to deliver reliable, maintainable data solutions in production.

Skills

Azure Databricks

PySpark

SQL

Python

Event-based ingestion

ETL/ELT

Data modelling

Distributed data processing

Production-grade data platforms

Tools

Azure Data Lake

ADF

Orchestration tools

Kafka

Event Hub

Job description

Brightwater Recruitment partners with a growing HealthTech company to hire a Senior Data Engineer on a 12-month contract in Dublin. The role is hands-on, delivering scalable data pipelines on the Azure data platform and collaborating with engineering leads across Ireland and the US.

The position requires 6+ years in data engineering, strong Azure Databricks and PySpark skills, and experience with Data Lake, ADF, Kafka or Event Hub, SQL and Python.