Senior Data Engineer — Lakehouse Pipelines & AI

G MASS Consulting; Dublin; On-site; EUR 110,000 - 150,000; Full time

Job summary

G MASS Consulting is seeking a Senior Data Engineer for a leading global Financial Services client in Dublin. This hands-on role sits at the center of an enterprise data platform, shaping architecture, driving pipeline development, and contributing to AI initiatives across a high-volume data environment.

You will design scalable Lakehouse solutions, develop ETL/ELT and streaming workflows, tune Spark jobs, and implement governance with Delta Lake, Unity Catalog, and IAM.

Qualifications

• 6+ years in data engineering with hands-on Databricks experience.
• Strong Python and Spark programming skills.
• Solid AWS experience including S3, Glue, and Lambda.
• Deep understanding of data modelling, SQL and ETL/ELT design patterns.
• Experience with Delta Lake and Lakehouse architecture.
• Demonstrated use of AI tools within a professional development workflow.
• Strong communication across technical and non-technical teams.

Responsibilities

• Design and develop scalable data solutions on a Lakehouse platform for enterprise-wide data processing and analytics.
• Build, optimise, and maintain ETL/ELT pipelines and streaming workflows for batch and real-time data ingestion.
• Configure and tune clusters and Spark jobs for consistent performance at scale.
• Utilise Delta Live Tables and Unity Catalog to manage data ingestion, transformation, and access governance.
• Apply IAM best practices and maintain compliance with data security standards.
• Support infrastructure provisioning and resource management using Terraform.
• Implement monitoring frameworks for pipeline performance and data quality.
• Contribute to code reviews, documentation, and knowledge sharing.
• Collaborate with data scientists, analysts, and business stakeholders in an Agile environment.
• Explore emerging technologies and AI tooling to boost productivity and platform capability.

Skills

Databricks

Python

Spark

AWS

SQL

Data modelling

ETL/ELT design

Tools

Delta Lake

Delta Live Tables

Unity Catalog

Terraform

Git

S3

AWS Glue

AWS Lambda

Job description

G MASS Consulting is seeking a Senior Data Engineer for a leading global Financial Services client in Dublin. This hands-on role sits at the center of an enterprise data platform, shaping architecture, driving pipeline development, and contributing to AI initiatives across a high-volume data environment.

You will design scalable Lakehouse solutions, develop ETL/ELT and streaming workflows, tune Spark jobs, and implement governance with Delta Lake, Unity Catalog, and IAM.