Senior Data Engineer

G MASS; Ireland; On-site; EUR 90,000 - 130,000; Full time

Job summary

G MASS is seeking a Senior Data Engineer in Ireland to join a growing data platform team. This is a hands-on role at the heart of an enterprise data platform build, shaping architecture and driving pipeline development.

You will design scalable Lakehouse data solutions, implement batch and real-time ETL/ELT, tune Spark workloads, and apply governance with Delta Live Tables and Unity Catalog. Collaboration with data scientists is essential.

Qualifications

• 6+ years of data engineering experience with at least 2 years on Databricks.
• Strong Python and Spark programming skills, SQL proficiency.
• Deep understanding of data modelling, ETL/ELT design patterns.
• Experience with Delta Lake, Lakehouse architecture, Git-based workflows.

Responsibilities

• Design and develop scalable data solutions on Lakehouse architecture for enterprise analytics.
• Build, optimise, and maintain ETL/ELT pipelines and streaming workflows for batch and real-time data.
• Tune clusters and Spark jobs to ensure performance at scale.
• Utilise Delta Live Tables and Unity Catalog for data ingestion, transformation, and governance.
• Apply IAM best practices and maintain data security standards across the platform.
• Support Terraform-based infrastructure provisioning and resource management.
• Implement monitoring for pipeline performance, data quality, and health.
• Contribute to code reviews, documentation, and knowledge sharing.

Skills

Databricks

Python

Spark

SQL

ETL/ELT design

Data modelling

Communication

Agile delivery

Tools

Delta Lake

Git

Terraform

AWS (S3, Glue, Lambda)

Delta Live Tables

Unity Catalog

Job description

We are working with a leading global Financial Services business to hire a Senior Data Engineer into their growing data engineering practice. This is a hands‑on technical role sitting at the centre of a major enterprise data platform build, with scope to influence architecture, drive pipeline development, and contribute to AI initiatives across a complex, high‑volume financial data environment.

Responsibilities:

• Design and develop scalable data solutions on a Lakehouse architecture platform, supporting enterprise‑wide data processing and analytics
• Build, optimise, and maintain ETL/ELT pipelines and structured streaming workflows for both batch and real‑time data ingestion
• Configure and tune clusters and Spark jobs to deliver consistent performance at scale
• Utilise Delta Live Tables and Unity Catalog to manage data ingestion, transformation, and access governance
• Apply IAM best practices and maintain compliance with data security standards across the platform
• Support infrastructure provisioning and resource management using Terraform
• Implement monitoring frameworks covering pipeline performance, data quality, and operational health
• Contribute to code reviews, technical documentation, and team knowledge‑sharing
• Work within an Agile delivery model, collaborating closely with data scientists, analysts, and business stakeholders
• Explore emerging technologies and AI tooling to enhance development productivity and platform capability

• 6+ years in data engineering, with at least 2 years hands‑on experience with Databricks
• Strong Python and Spark programming skills
• Solid AWS experience across core services including S3, Glue, and Lambda
• Deep understanding of data modelling, SQL, and ETL/ELT design patterns
• Experience with Delta Lake, Lakehouse architecture, and Git‑based version control
• Demonstrable use of AI tools within a professional development workflow
• Strong communication skills and the ability to work effectively across technical and non‑technical teams

Desirable:

• Financial services or fund administration background
• Exposure to AI/ML implementation patterns and real‑time data processing frameworks
• Multi‑cloud experience beyond AWS
• API development or data governance framework experience
• Experience mentoring junior engineers

Salary: to be discussed, depending on experience

Length: Permanent contract