Lead Data Engineer - Databricks & Spark Architect

Aon Corporation; Singapore; Hybrid; SGD 100,000 - 140,000; Full time

Job summary

A global professional services firm based in Singapore is seeking a Lead Data Engineer to design and implement scalable data architectures. The successful candidate should have over 8 years of experience working with data integration teams and 4+ years of in-depth experience with Databricks and Apache Spark. This is a unique opportunity to collaborate with cross-functional teams in a diverse and inclusive environment that promotes employee wellbeing and continuous learning.

Benefits

Comprehensive benefits package

Global Wellbeing Days

Flexible working environment

Qualifications

• 8+ years of experience working with data integration teams.
• 5+ years of experience in data architecture, database design, and data management.
• 4+ years developing data pipelines within an Apache Spark environment.

Responsibilities

• Collaborate with cross-functional teams to deliver projects.
• Design and implement scalable data architectures.
• Define standards for Spark-based ETL/ELT Development.
• Drive automation and infrastructure-as-code practices.

Skills

Databricks

Apache Spark

Pyspark

Python

SQL

Data modelling

Data warehousing

ETL/ELT processes

Cloud platforms (AWS or Azure)

BI tools (Power BI or Tableau)

Job description

A global professional services firm based in Singapore is seeking a Lead Data Engineer to design and implement scalable data architectures. The successful candidate should have over 8 years of experience working with data integration teams and 4+ years of in-depth experience with Databricks and Apache Spark. This is a unique opportunity to collaborate with cross-functional teams in a diverse and inclusive environment that promotes employee wellbeing and continuous learning.