Senior Data Engineer: Spark & Big Data Pipelines (12m)

Ethos BeathChapman; Singapore; Presencial; SGD 90.000 - 130.000; Jornada completa

Descripción de la vacante

A leading global fintech organisation is hiring a Data Engineer on a 12-month contract in Singapore to underpin high-priority data initiatives.

The role requires 5–8 years in data engineering, with at least 2 years using Apache Spark, and hands-on CDP in production. Strong SQL, Python, and Bash in Linux environments are essential.

You will build and maintain large-scale data pipelines using Kafka, Hive, Spark, and Airflow, focusing on data validation, transformation, and troubleshooting.

Formación

• 5–8 years of experience as a Data Engineer, incl. at least 2 years working extensively with Apache Spark.
• Hands‑on experience with Cloudera Data Platform (CDP) in a production environment.
• Strong expertise in Apache Spark, Spark Core, Spark SQL, and performance tuning.
• Experience building and supporting large‑scale data pipelines using Kafka, Hive, Spark, and Airflow.
• Advanced SQL skills with data validation, transformation, and troubleshooting.
• Proficiency in Python and Bash scripting within Linux environments.

Conocimientos

Apache Spark

SQL

Python

Bash scripting

Linux

Herramientas

Cloudera Data Platform (CDP)

Kafka

Hive

Airflow

Spark Core

Spark SQL

Descripción del empleo

A leading global fintech organisation is hiring a Data Engineer on a 12-month contract in Singapore to underpin high-priority data initiatives.

The role requires 5–8 years in data engineering, with at least 2 years using Apache Spark, and hands-on CDP in production. Strong SQL, Python, and Bash in Linux environments are essential.

You will build and maintain large-scale data pipelines using Kafka, Hive, Spark, and Airflow, focusing on data validation, transformation, and troubleshooting.