Data Engineering Lead

TopTalent Recruitment Agency; Dublin; On-site; EUR 110,000 - 140,000; Full time

Benefits offered by this job

Competitive salary

Leadership opportunity

Global engineering environment

Enterprise-scale platforms

Job summary

Top Talent Recruitment is working with a leading tech outsourcing company to recruit a Data Engineering Lead to join their team in Dublin, Ireland. This full-time role will lead the design, development and deployment of scalable data systems for analytics and AI initiatives.

You will drive large-scale data pipelines, collaborate with data scientists and engineers, mentor a squad of data engineers, and promote best practices in cloud-based platforms and ETL/ELT workflows.

Qualifications

• 8+ years in Data Engineering or Big Data roles.
• Strong coding in Python/Scala/Java.
• Hands-on with Spark, Databricks, and Hadoop ecosystem.
• Experience building scalable data pipelines.
• Experience leading technical initiatives.

Responsibilities

• Lead design and implementation of scalable data engineering solutions.
• Build and optimise large-scale data pipelines for analytics and ML.
• Define data architecture for scalability and reliability.
• Mentor data engineers and promote agile practices.
• Collaborate with data scientists, product managers and engineers.
• Ensure data quality and platform performance.

Skills

Python

Scala

Java

Spark

Databricks

Hadoop

SQL

NoSQL

Distributed systems

Leadership

Education

Degree in Computer Science or related field

Tools

AWS

Azure

Job description

Top Talent Recruitment is working with a leading tech outsourcing company that is looking to recruit a Data Engineering Lead to join their team in Dublin, Ireland.

Position

Data Engineering Lead

Location:

Onsite - Dublin, Ireland

Employment type:

Full-time

Remuneration:

Competitive package.

DUTIES AND RESPONSIBILITIES:

• Lead the design, development, and implementation of scalable data engineering solutions
• Build and optimise large-scale data pipelines for analytics and machine learning use cases
• Design and maintain reusable, high-performance data products and frameworks
• Integrate data from multiple structured and unstructured sources into unified platforms
• Drive automation across data engineering and data science workflows
• Define and evolve data architecture to support scalability, reliability, and performance
• Identify opportunities to simplify complex systems and improve platform efficiency
• Ensure best practices in engineering design, coding standards, and system reliability
• Collaborate on the design of distributed systems and cloud-based data platforms
• Work closely with Data Scientists, Product Managers, and Engineering teams
• Translate business requirements into scalable technical solutions
• Support cross-functional delivery of data-driven products and services
• Communicate technical concepts effectively to both technical and non-technical stakeholders
• Lead and mentor data engineers across projects and squads
• Provide technical guidance and support engineering capability development
• Contribute to team growth and engineering excellence across the organisation
• Promote agile delivery and collaborative engineering practices
• Develop and maintain robust ETL/ELT pipelines
• Optimise performance of data processing systems and workflows
• Ensure data quality, reliability, and consistency across platforms
• Support production-grade deployment of data engineering solutions.

REQUIREMENTS:

• 8+ years of experience in Data Engineering or Big Data environments
• Strong experience with Python, Scala, or Java
• Hands-on experience with Apache Spark / PySpark
• Strong experience with Databrick
• Experience with Hadoop ecosystem (Hive, Impala, Oozie, Sqoop, NiFi)
• Strong SQL skills and experience with relational and NoSQL databases
• Experience building and maintaining large-scale data pipelines
• Strong understanding of distributed systems and data architecture principles
• Experience working in Agile engineering environments
• Proven experience leading technical initiatives or engineering teams
• Degree in Computer Science, Software Engineering, or related field
• Experience with cloud-native data engineering platforms/Cloud experience (AWS or Azure).

BENEFITS:

• Competitive salary package aligned to senior data engineering market
• Opportunity to work on enterprise-scale payment technology platforms
• Exposure to cutting-edge Big Data, cloud, and analytics ecosystems
• Leadership opportunity within a global engineering organisation
• Career progression within a major international technology environment
• Work on high-impact data platforms powering analytics and AI solutions
• Guidance and tools to reach career potential.