Senior Data Engineer - Databricks Lakehouse on AWS

The Citco Group Limited; Dublin; On-site; EUR 70,000 - 90,000; Full time

Benefits offered by this job

Flexible working arrangements

Training and education support

Job summary

A leading financial services firm in Dublin is seeking a Senior Data Engineer to enhance the Centralized Data Platform using Databricks. You will develop scalable data pipelines, implement governance standards, and collaborate with data scientists to turn financial data into actionable insights. This role demands solid experience in data engineering, Python, and AWS cloud services, offering a chance to work with innovative technologies and a commitment to employee welfare and diversity.

Qualifications

• 6+ years of experience in data engineering.
• 2+ years of hands-on experience with Databricks platform.
• Demonstrable experience in using AI in development.

Responsibilities

• Design and develop Databricks solutions leveraging Lakehouse architecture.
• Develop and optimize ETL/ELT pipelines.
• Create and manage structured streaming pipelines for real-time data processing.

Skills

Python

Spark programming

ETL/ELT principles

Data modeling and SQL

Git

Problem-solving

Collaboration abilities

Tools

Databricks

AWS

Delta Lake

Unity Catalog

Job description

A leading financial services firm in Dublin is seeking a Senior Data Engineer to enhance the Centralized Data Platform using Databricks. You will develop scalable data pipelines, implement governance standards, and collaborate with data scientists to turn financial data into actionable insights. This role demands solid experience in data engineering, Python, and AWS cloud services, offering a chance to work with innovative technologies and a commitment to employee welfare and diversity.