Senior Data Platform Engineer: Cloud Lakehouse & Pipelines

RTE; Dublin; On-site; EUR 51,000 - 86,000; Full time

Job summary

RTÉ is seeking a Senior Data Engineer in Ireland to design and build its next-generation data platform. You will lead end-to-end data pipelines (batch and streaming) and collaborate with analytics teams to deliver trusted datasets.

Reporting to the Head of Data Engineering, you will shape the platform architecture, implement best practices, and mentor other engineers while staying at the forefront of data engineering innovations.

Qualifications

• Bachelor's or master's degree in Computer Science or related field, or equivalent experience in data engineering.
• 5+ years of enterprise data engineering experience.
• Strong experience building and managing cloud-based data platforms.
• Hands on experience with Microsoft Fabric or closely related tools (Azure Data Factory, ADLS, Synapse, Azure Databricks).
• Strong programming skills in SQL and Python, with Spark/PySpark a bonus.
• Proven experience designing and implementing data pipelines, lakehouses and data warehouses.
• Good understanding of modern data architecture patterns (e.g. ELT, Medallion architecture).
• Experience working with large, complex datasets, including structured and unstructured data.
• Familiarity with version control, CI/CD and agile development best practices.

Responsibilities

• Build and optimise end to end data pipelines (batch and streaming), ensuring reliability, performance and maintainability
• Develop and maintain Lakehouse architectures and data models to support advanced analytics and reporting
• Work closely with analytics teams to deliver high quality, trusted datasets
• Contribute to the design of RTÉ’s data platform architecture, including standards, tooling and best practices
• Implement best practices across data engineering, including testing, performance optimisation, monitoring and documentation
• Contribute to improving data quality, governance and security standards across the organisation
• Support project teams with the design and delivery of data engineering solutions as required
• Mentor and support other engineers, helping to build a strong engineering culture of learning, ownership and continuous improvement
• Stay current with emerging technologies and bring innovation and new ideas into the team

Skills

Cloud data platforms

SQL

Python

Spark/PySpark

Data pipelines

Lakehouses

Data warehouses

ETL/ELT

Agile

CI/CD

Version control

Education

Bachelor's or Master's in CS or related field

Tools

Microsoft Fabric

Azure Data Factory

ADLS

Synapse

Azure Databricks

CI/CD tooling

Job description

RTÉ is seeking a Senior Data Engineer in Ireland to design and build its next-generation data platform. You will lead end-to-end data pipelines (batch and streaming) and collaborate with analytics teams to deliver trusted datasets.

Reporting to the Head of Data Engineering, you will shape the platform architecture, implement best practices, and mentor other engineers while staying at the forefront of data engineering innovations.