Senior Databricks Data Engineer: Pipelines, AI & Cloud

Jobtailor; Dublin; On-site; EUR 90,000 - 120,000; Full time

Job summary

Jobtailor in Dublin seeks an experienced Data Engineer to support a large-scale data transformation programme and build data pipelines in Databricks. You will develop ETL pipelines, orchestrate workflows, and create data products for analytics use cases.

Collaborate with analysts, architects and stakeholders to ensure robust data solutions, while advancing AI-assisted development within Databricks and contributing to best practices across the team.

Qualifications

• Databricks Data Engineering experience required.
• ETL pipelines and orchestration frameworks experience.
• Strong Python development skills.
• Experience with cloud-based data platforms.
• AWS experience is advantageous.
• Strong SQL and data modelling knowledge.
• Experience delivering data solutions using Databricks.

Responsibilities

• Support the delivery of a large-scale data transformation programme.
• Build, optimise and maintain data pipelines within a modern Databricks environment.
• Develop, orchestrate, and maintain ETL pipelines within Databricks using medallion architectures.
• Create high-quality, secure Data Products for analytics use cases.
• Collaborate with Data Analysts, Architects and business stakeholders.
• Act as escalation point for data integration and transformation activities.
• Drive improvements in data quality, performance and reliability.
• Contribute to engineering standards and best practices.
• Support AI-assisted development approaches where appropriate.
• Participate in design and architecture reviews for robust data solutions.

Skills

Databricks Data Engineering

Python development

SQL & Data Modelling

ETL pipelines

Cloud-based data platforms

AI-assisted development

Data quality & reliability

Problem solving

Data transformation

Enterprise data engineering

Tools

Databricks

AWS

ETL Orchestration Frameworks

Job description

Jobtailor in Dublin seeks an experienced Data Engineer to support a large-scale data transformation programme and build data pipelines in Databricks. You will develop ETL pipelines, orchestrate workflows, and create data products for analytics use cases.

Collaborate with analysts, architects and stakeholders to ensure robust data solutions, while advancing AI-assisted development within Databricks and contributing to best practices across the team.