Databricks Tech Lead — Hands-On Data Engineer

Nicoll Curtin; Leinster; Hybrid; EUR 120,000 - 160,000; Full time

Job summary

Nicoll Curtin is seeking a Databricks Tech Lead in Dublin with a hands-on approach to data engineering and platform optimisation. You will lead technical design and development while remaining actively involved in coding, performance tuning and decision-making.

You will guide the team through scalable data pipelines, Spark workloads and Delta Lake implementations in a hybrid Dublin setting, collaborating with data engineers, architects and stakeholders to deliver robust solutions.

Qualifications

• Hands-on Databricks in production environments.
• Extensive data engineering experience with complex pipelines.
• Proficient in Python, PySpark and SQL.

Responsibilities

• Lead the design and development of scalable data engineering solutions with Databricks.
• Guide hands-on development across data pipelines and ETL/ELT workloads.
• Provide technical leadership, conduct code reviews and establish best practices.
• Optimize Spark workloads for performance, reliability and cost.
• Ensure data quality, governance, security and platform reliability.
• Collaborate with data engineers, architects and stakeholders to deliver robust solutions.
• Troubleshoot complex issues and drive continuous improvement.

Skills

Databricks

Python

PySpark

SQL

Apache Spark

Delta Lake

Lakehouse

Spark tuning

Team leadership

Tools

Azure

AWS

CI/CD

Job description

Nicoll Curtin is seeking a Databricks Tech Lead in Dublin with a hands-on approach to data engineering and platform optimisation. You will lead technical design and development while remaining actively involved in coding, performance tuning and decision-making.

You will guide the team through scalable data pipelines, Spark workloads and Delta Lake implementations in a hybrid Dublin setting, collaborating with data engineers, architects and stakeholders to deliver robust solutions.