Databricks Lakehouse Lead Data Engineer (Contract)

Cpl; Dublin; On-site; EUR 90,000 - 130,000; Full time

Job summary

CPL is seeking a Data Engineering Lead to own the design and delivery of scalable data pipelines and lakehouse solutions on Databricks. You will drive architectural decisions, mentor engineers, and ensure governance and quality across platforms.

The role requires 5+ years in data engineering with 3+ years on Databricks, strong SQL/PySpark, and a focus on reliability, cost, and performance. Commutable to Dublin, full-time, fixed-term with view to permanency.

Qualifications

• 5+ years in data engineering
• 3+ years hands-on on Databricks
• Strong SQL and PySpark/Spark SQL expertise
• Experience with Delta Lake and Unity Catalog
• Familiarity with Databricks tooling and CI/CD
• Must have the relevant Visa for a full time position and live within a commutable distance to Dublin

Responsibilities

• Pipeline Engineering — Design and own scalable ETL/ELT pipelines (PySpark, Spark SQL, Delta Live Tables) following medallion architecture.
• Data Modelling & Lakehouse — Govern Delta Lake models and modelling standards across Bronze/Silver/Gold layers.
• Platform & Architecture — Own Databricks platform architecture and tooling decisions (Delta Lake, Unity Catalog, Databricks SQL, structured streaming).
• Reliability & Observability — Define SLAs and implement observability (lineage, monitoring, metrics).
• Leadership & Collaboration — Act as technical lead for the data engineering function; mentor engineers; lead design reviews and architecture discussions.
• Governance & Auditability — Ensure traceable, well-governed data processes via Unity Catalog; maintain documentation and compliance.
• Partner Management — Oversee external delivery partners, ensuring quality and knowledge transfer.

Skills

Databricks

SQL

PySpark

Delta Lake

Unity Catalog

CI/CD

Leadership

Stakeholder comms

Medallion architecture

Education

Bachelor's degree in CS/Data Engineering

Tools

Databricks Workflows

Job description

CPL is seeking a Data Engineering Lead to own the design and delivery of scalable data pipelines and lakehouse solutions on Databricks. You will drive architectural decisions, mentor engineers, and ensure governance and quality across platforms.

The role requires 5+ years in data engineering with 3+ years on Databricks, strong SQL/PySpark, and a focus on reliability, cost, and performance. Commutable to Dublin, full-time, fixed-term with view to permanency.