Senior Data Engineer

Jobtailor; Dublin; On-site; EUR 90,000 - 120,000; Full time

Job summary

Jobtailor in Dublin seeks an experienced Data Engineer to support a large-scale data transformation programme and build data pipelines in Databricks. You will develop ETL pipelines, orchestrate workflows, and create data products for analytics use cases.

Collaborate with analysts, architects and stakeholders to ensure robust data solutions, while advancing AI-assisted development within Databricks and contributing to best practices across the team.

Qualifications

• Databricks Data Engineering experience required.
• ETL pipelines and orchestration frameworks experience.
• Strong Python development skills.
• Experience with cloud-based data platforms.
• AWS experience is advantageous.
• Strong SQL and data modelling knowledge.
• Experience delivering data solutions using Databricks.

Responsibilities

• Support the delivery of a large-scale data transformation programme.
• Build, optimise and maintain data pipelines within a modern Databricks environment.
• Develop, orchestrate, and maintain ETL pipelines within Databricks using medallion architectures.
• Create high-quality, secure Data Products for analytics use cases.
• Collaborate with Data Analysts, Architects and business stakeholders.
• Act as escalation point for data integration and transformation activities.
• Drive improvements in data quality, performance and reliability.
• Contribute to engineering standards and best practices.
• Support AI-assisted development approaches where appropriate.
• Participate in design and architecture reviews for robust data solutions.

Skills

Databricks Data Engineering

Python development

SQL & Data Modelling

ETL pipelines

Cloud-based data platforms

AI-assisted development

Data quality & reliability

Problem solving

Data transformation

Enterprise data engineering

Tools

Databricks

AWS

ETL Orchestration Frameworks

Job description

Responsibilities

• Support the delivery of a large‑scale data transformation programme
• Build, optimise and maintain data pipelines within a modern Databricks environment
• Develop, orchestrate, and maintain ETL pipelines and related objects within Databricks utilising medallion architecture structures
• Create high‑quality, performant, and secure Data Products for analytics use cases
• Collaborate with Data Analysts, Architects and business stakeholders
• Act as an escalation point in supporting data integration and transformation activities
• Drive improvements in data quality, performance and reliability
• Contribute to engineering standards and best practices
• Support the adoption of AI‑assisted development approaches where appropriate
• Actively participate in design and architecture reviews, contributing pragmatically to ensure robust data solutions are proposed

Requirements

• Strong Databricks Data Engineering experience
• Databricks certification is highly advantageous
• Experience developing ETL pipelines and orchestration frameworks
• Strong Python development skills
• Experience working with cloud‑based data platforms
• AWS experience is an advantage
• Strong SQL and data modelling knowledge
• Excellent problem‑solving and analytical abilities
• Proven Data Engineering experience within enterprise environments
• Experience delivering data solutions using Databricks
• Experience working with large‑scale data transformation initiatives
• Experience with AI‑assisted development within Databricks
• Insurance or Financial Services experience would be highly beneficial