Lead Data Engineer

Fruition Group; Dublin; Hybrid; EUR 110,000 - 135,000; Full time

Benefits offered by this job

Hybrid working model

Pension contribution

Healthcare package

Life assurance

Professional training & certification

Career progression opportunities

Job summary

Fruition Group seeks an experienced Lead Data Engineer to design, develop and evolve cloud-based data platforms. The role combines hands-on delivery with architectural leadership, leveraging Python and AWS to deliver enterprise-scale data solutions.

You will guide data engineering initiatives, design robust ETL/ELT pipelines, and collaborate with solution architects, software engineers and stakeholders to ensure scalable, secure and high-performing data platforms.

Qualifications

• Minimum of 10 years' experience in Data Engineering or related field.
• Extensive hands-on experience designing and building enterprise-scale data platforms.
• Strong expertise developing solutions using Python.

Responsibilities

• Lead architecture, design and implementation of scalable data solutions.
• Design cloud-native data platforms using AWS and Python.
• Provide technical leadership while remaining hands-on with delivery.
• Design robust ETL/ELT pipelines for large-scale data ingestion and transformation.
• Drive best practices around data architecture, governance, security, scalability and performance.
• Collaborate with architects, engineers, stakeholders and product teams.
• Evaluate emerging technologies and improve data frameworks.
• Mentor engineering teams through technical leadership and code reviews.
• Ensure solutions are resilient and aligned with standards.

Skills

Python

AWS

Data engineering

Cloud architecture

Stakeholder communication

Education

Bachelor's degree or higher in CS/SE/IT

Tools

Terraform

AWS CloudFormation

Apache Airflow

Docker

Kubernetes

Job description

Job Description

Lead Data Engineer Job Description

Our client, a leading organisation, is seeking an experienced Lead Data Engineer to play a key technical leadership role in the design, development and evolution of modern cloud-based data platforms. This is a hands-on architectural position suited to an experienced data engineering professional with deep expertise in Python, AWS and enterprise-scale data solutions.

Job Responsibilities

• Lead the architecture, design and implementation of scalable, secure and high-performing data engineering solutions.
• Design and develop modern cloud-native data platforms using AWS services and Python.
• Provide technical leadership and architectural guidance across data engineering initiatives while remaining hands-on with solution delivery.
• Design robust ETL/ELT pipelines to support large-scale data ingestion, transformation and integration requirements.
• Drive best practices around data architecture, governance, security, scalability and performance optimisation.
• Collaborate with solution architects, software engineers, business stakeholders and product teams to deliver enterprise data solutions.
• Evaluate emerging technologies and recommend improvements to existing data engineering frameworks and platforms.
• Mentor and support engineering teams through technical leadership, code reviews and architectural direction without direct people management responsibilities.
• Ensure solutions are resilient, maintainable and aligned with enterprise architecture standards.

Experience Required

• Minimum of 10 years' experience in Data Engineering, Data Platform Engineering or a closely related technical discipline.
• Extensive hands-on experience designing and building enterprise-scale data platforms.
• Strong expertise developing solutions using Python.
• Extensive experience delivering cloud-native data solutions within AWS environments.
• Proven experience designing modern data architectures and implementing scalable data pipelines.
• Strong understanding of data modelling, data warehousing and distributed data processing concepts.
• Experience working with large, complex datasets in enterprise environments.
• Excellent stakeholder engagement skills with the ability to communicate technical concepts to both technical and non-technical audiences.
• Strong analytical and problem-solving abilities with a focus on delivering high-quality technical solutions.

Desirable Skills

• Experience with AWS services such as Glue, Lambda, EMR, Redshift, S3, Athena and Step Functions.
• Experience with Infrastructure as Code tools such as Terraform or AWS CloudFormation.
• Knowledge of modern orchestration frameworks including Apache Airflow or similar.
• Experience working with containerisation technologies such as Docker and Kubernetes.
• Exposure to streaming technologies including Kafka or Kinesis.
• Understanding of CI/CD pipelines and DevOps practices.
• Experience working within Agile delivery environments.
• Knowledge of data governance, security and regulatory best practices.

Educational Requirements

• Bachelor's degree or higher in Computer Science, Software Engineering, Information Technology or a related discipline.
• Relevant cloud or data engineering certifications (such as AWS Certified Solutions Architect, AWS Certified Data Engineer or equivalent) would be advantageous.

Working Hours & Benefits

• Hybrid working model based in Dublin 2.
• Competitive salary package (Circa 120k base salary plus bonus and strong benefits).
• Performance-related bonus.
• Pension contribution.
• Healthcare package.
• Life assurance.
• Professional training and certification support.
• Career progression opportunities within a growing technology team.