Data Engineering Lead

TopTalent Recruitment - Careers; Dublin; On-site; EUR 80,000 - 100,000; Full time

Benefits offered by this job

Competitive salary package

Opportunity to work on enterprise-scale platforms

Career progression within a major technology environment

Job summary

TopTalent Recruitment is seeking a Data Engineering Lead for a leading tech outsourcing company in Dublin, Ireland. The role involves leading the design and implementation of scalable data engineering solutions, collaborating closely with Data Scientists and Product Managers.

Candidates should have over 8 years of experience in Data Engineering, strong expertise in Python or Scala, and familiarity with cloud platforms like AWS or Azure. This position offers a competitive salary and an opportunity to work on enterprise-scale payment technology platforms.

Qualifications

• 8+ years of experience in Data Engineering or Big Data environments.
• Experience building and maintaining large-scale data pipelines.
• Proven experience leading technical initiatives or engineering teams.

Responsibilities

• Lead data engineering solutions' design and development.
• Build and optimise large-scale data pipelines for analytics.
• Collaborate on the design of distributed systems and cloud platforms.

Skills

Python

Scala

Java

Apache Spark / PySpark

Databricks

Hadoop ecosystem

SQL

NoSQL databases

Distributed systems

Agile environments

Education

Degree in Computer Science or Software Engineering

Job description

Top TalentRecruitment is working with a leading tech outsourcing company that is looking to recruit a Data Engineering Lead to join their team in Dublin, Ireland.

Position: Data Engineering Lead

Location: Onsite - Dublin, Ireland

Employment type: Full-time

Remuneration: Competitive package.

DUTIES AND RESPONSIBILITIES

• Lead the design, development, and implementation of scalable data engineering solutions
• Build and optimise large-scale data pipelines for analytics and machine learning use cases
• Design and maintain reusable, high-performance data products and frameworks
• Integrate data from multiple structured and unstructured sources into unified platforms
• Drive automation across data engineering and data science workflows
• Define and evolve data architecture to support scalability, reliability, and performance
• Identify opportunities to simplify complex systems and improve platform efficiency
• Ensure best practices in engineering design, coding standards, and system reliability
• Collaborate on the design of distributed systems and cloud-based data platforms
• Work closely with Data Scientists, Product Managers, and Engineering teams
• Translate business requirements into scalable technical solutions
• Support cross-functional delivery of data-driven products and services
• Communicate technical concepts effectively to both technical and non-technical stakeholders
• Lead and mentor data engineers across projects and squads
• Provide technical guidance and support engineering capability development
• Contribute to team growth and engineering excellence across the organization
• Promote agile delivery and collaborative engineering practices
• Develop and maintain robust ETL/ELT pipelines
• Optimise performance of data processing systems and workflows
• Ensure data quality, reliability, and consistency across platforms
• Support production-grade deployment of data engineering solutions.

REQUIREMENTS

• 8+ years of experience in Data Engineering or Big Data environments
• Strong experience with Python, Scala, or Java
• Hands‑on experience with Apache Spark / PySpark
• Strong experience with Databricks
• Experience with Hadoop ecosystem (Hive, Impala, Oozie, Sqoop, NiFi)
• Strong SQL skills and experience with relational and NoSQL databases
• Experience building and maintaining large-scale data pipelines
• Strong understanding of distributed systems and data architecture principles
• Experience working in Agile engineering environments
• Proven experience leading technical initiatives or engineering teams
• Degree in Computer Science, Software Engineering, or related field
• Experience with cloud‑native data engineering platforms/Cloud experience (AWS or Azure).

BENEFITS

• Competitive salary package aligned to senior data engineering market
• Opportunity to work on enterprise‑scale payment technology platforms
• Exposure to cutting‑edge Big Data, cloud, and analytics ecosystems
• Leadership opportunity within a global engineering organization
• Career progression within a major international technology environment
• Work on high-impact data platforms powering analytics and AI solutions
• Guidance and tools to reach career potential.