Data Engineer Lead

Kerry Consulting; Singapore; On-site; SGD 150,000 - 190,000; Full time

Job summary

Kerry Consulting is seeking a Lead Data Engineer in Singapore to design and build scalable data platforms and pipelines. You will lead delivery, set engineering standards, and collaborate with analytics, software, and AI/ML teams.

The role combines hands-on data engineering with technical leadership, mentoring, and architecture decisions to elevate data capabilities across the organisation.

Qualifications

• 5–10 years of data engineering experience with production-grade platforms.
• Strong hands-on expertise in Python and SQL.
• Experience leading data engineering teams and projects.

Responsibilities

• Lead design, development, and evolution of scalable data platforms and pipelines.
• Provide technical leadership across data architecture, ETL/ELT, and orchestration.
• Mentor engineers, conduct reviews, and drive engineering standards.
• Champion AI-enabled data engineering practices and tooling.

Skills

Technical leadership

Mentoring

Hands-on data engineering

Communication

Education

Bachelor’s degree in CS/Engineering

Tools

Apache Spark

PySpark

Airflow

Cloud platforms (AWS/Azure/GCP)

Job description

This is a fast-growing organization investing in modern data and AI capabilities to support digital products, analytics, and AI-driven innovation. As part of its continued expansion, the organization is seeking to appoint a Lead Data Engineer to design and build scalable data platforms and lead the delivery of high-quality data engineering solutions.

This is an excellent opportunity for an experienced data engineer who wants to remain hands-on while providing technical leadership, shaping engineering standards, and working closely with software, analytics, and AI/ML teams.

Responsibilities

You will lead the design, development, and evolution of scalable data platforms and pipelines supporting analytics, digital products, and AI/ML workloads. You will provide technical leadership across data architecture, data modelling, ETL/ELT, distributed processing, orchestration, data quality, and platform reliability.

Working closely with data engineers, software engineers, data scientists, and AI engineers, you will design robust data pipelines and ensure that data is reliable, accessible, and optimized for downstream consumption. You will establish engineering standards around testing, validation, observability, CI/CD, and automation while guiding the team on system design and architectural decisions.

You will also champion the adoption of AI-enabled engineering practices, leveraging copilots, agents, and other AI development tools to accelerate development, improve code and data quality, automate engineering workflows, and enhance overall team productivity. As a technical lead, you will mentor engineers, conduct design and code reviews, and help develop engineering capability across the team.

Requirements

We are looking for a Lead Data Engineer with 5-10 years of experience designing and delivering production-grade data platforms and pipelines, with demonstrated experience providing technical leadership to engineering teams.

You should have strong experience with modern cloud-based data platforms and architectures, with hands-on expertise building scalable data solutions in AWS, Azure, or Google Cloud environments. Strong proficiency in Python and SQL is essential, together with practical experience in distributed data processing technologies such as Apache Spark / PySpark.

You should have hands-on experience with data orchestration and workflow management, as well as establishing data quality practices covering automated testing, validation, monitoring, and observability. A solid understanding of data modelling, data warehousing, and modern data architecture principles is essential.

Experience building and operating data pipelines that support analytics, machine learning, and Generative AI workloads is highly desirable. You should also have practical exposure to AI-enabled data engineering practices, including using copilots, AI agents, or similar tools across the engineering lifecycle to improve development productivity, automation, testing, documentation, and solution quality.

The ideal candidate will combine strong hands-on engineering capability with proven experience in system design, architecture, technical decision-making, and mentoring or leading data engineers.

Licence No: 16S8060 Registration No: R1549515