Lead Data Software Engineer

Fruition Group Ireland; Dublin; Hybrid; EUR 110,000 - 140,000; Full time

Job summary

Fruition Group Ireland is seeking an experienced Lead Data Engineer to drive the design, development and evolution of modern cloud-based data platforms. This hands-on architectural role focuses on Python, AWS and enterprise-scale data solutions.

You will lead architecture, design and implementation, mentor teams and work with stakeholders to deliver scalable data infrastructure, governance and performance improvements across complex datasets.

Qualifications

• 10+ years in Data Engineering or closely related field.
• Experience delivering enterprise-scale cloud-native data platforms on AWS.
• Strong grasp of data modelling, warehousing and distributed processing.
• Excellent ability to communicate complex concepts to diverse audiences.

Responsibilities

• Lead architecture, design and implementation of scalable, secure data engineering solutions.
• Design cloud-native data platforms using AWS and Python.
• Provide technical leadership while remaining hands-on with delivery.
• Develop robust ETL/ELT pipelines for large-scale ingestion and transformation.
• Drive best practices in data governance, security, scalability and performance.
• Collaborate with solution architects, software engineers and stakeholders to deliver enterprise data solutions.
• Evaluate emerging technologies and improve data frameworks and platforms.
• Mentor engineering teams through technical leadership and code reviews.
• Ensure solutions are resilient and aligned with enterprise standards.

Skills

Python

AWS

Data platform design

Architectural leadership

ETL/ELT pipelines

Stakeholder communication

DevOps / CI-CD

Airflow

Docker/Kubernetes

Education

Bachelor's degree in Computer Science, Software Engineering, IT or related

AWS/Azure/Data Engineering certifications

Tools

Terraform

AWS CloudFormation

Airflow

Docker

Kubernetes

Kafka/Kinesis

Redshift

S3

Glue

Lambda

EMR

Job description

Our client, a leading organisation, is seeking an experienced Lead Data Engineer to play a key technical leadership role in the design, development and evolution of modern cloud-based data platforms. This is a hands‑on architectural position suited to an experienced data engineering professional with deep expertise in Python, AWS and enterprise-scale data solutions.

Job Responsibilities

• Lead the architecture, design and implementation of scalable, secure and high-performing data engineering solutions.
• Design and develop modern cloud-native data platforms using AWS services and Python.
• Provide technical leadership and architectural guidance across data engineering initiatives while remaining hands‑on with solution delivery.
• Design robust ETL/ELT pipelines to support large-scale data ingestion, transformation and integration requirements.
• Drive best practices around data architecture, governance, security, scalability and performance optimisation.
• Collaborate with solution architects, software engineers, business stakeholders and product teams to deliver enterprise data solutions.
• Evaluate emerging technologies and recommend improvements to existing data engineering frameworks and platforms.
• Mentor and support engineering teams through technical leadership, code reviews and architectural direction without direct people management responsibilities.
• Ensure solutions are resilient, maintainable and aligned with enterprise architecture standards.

Experience Required

• Minimum of 10 years' experience in Data Engineering, Data Platform Engineering or a closely related technical discipline.
• Extensive hands‑on experience designing and building enterprise-scale data platforms.
• Extensive experience delivering cloud-native data solutions within AWS environments.
• Proven experience designing modern data architectures and implementing scalable data pipelines.
• Strong understanding of data modelling, data warehousing and distributed data processing concepts.
• Experience working with large, complex datasets in enterprise environments.
• Excellent stakeholder engagement skills with the ability to communicate technical concepts to both technical and non-technical audiences.
• Strong analytical and problem-solving abilities with a focus on delivering high-quality technical solutions.
• Experience with AWS services such as Glue, Lambda, EMR, Redshift, S3, Athena and Step Functions.
• Experience with Infrastructure as Code tools such as Terraform or AWS CloudFormation.
• Knowledge of modern orchestration frameworks including Apache Airflow or similar.
• Experience working with containerisation technologies such as Docker and Kubernetes.
• Exposure to streaming technologies including Kafka or Kinesis.
• Understanding of CI/CD pipelines and DevOps practices.
• Experience working within Agile delivery environments.
• Knowledge of data governance, security and regulatory best practices.

Educational Requirements

• Bachelor's degree or higher in Computer Science, Software Engineering, Information Technology or a related discipline.
• Relevant cloud or data engineering certifications (such as AWS Certified Solutions Architect, AWS Certified Data Engineer or equivalent) would be advantageous.
• Hybrid working model based in Dublin 2.
• Competitive salary package (Circa 120k base salary plus bonus and strong benefits).
• Performance-related bonus.
• Pension contribution.
• Life assurance.
• Professional training and certification support.
• Career progression opportunities within a growing technology team.