Contract Data Engineer - Spark & CDP Pipelines Lead

Tookitaki Holding PTE LTD; Singapore; On-site; SGD 80,000 - 120,000; Full time

Job summary

A tech firm specializing in financial solutions is seeking a Data Engineer for a 6-month contract in Singapore. The role involves supporting high-priority data initiatives, focusing on building and maintaining robust data pipelines. Ideal candidates will have extensive experience in Apache Spark and Cloudera, with responsibilities including designing pipelines, data validation, and cross-functional collaboration. Join a dynamic team dedicated to enhancing AI-driven financial crime prevention efforts.

Qualifications

• 5–8 years as a Data Engineer, with at least 2 years in Spark-heavy environments.
• Prior experience working with Cloudera Data Platform (CDP) in production.

Responsibilities

• Design and optimize batch and streaming pipelines using Apache Spark.
• Build ingestion pipelines using Kafka, Hive, and Spark for large-scale financial datasets.
• Write and optimize SQL queries to validate data accuracy and ingestion success.

Skills

Apache Spark expertise

Cloudera CDP handling

SQL optimization

Kafka

Airflow orchestration

Python scripting

Bash scripting

Linux environments familiarity

Education

Bachelor’s/Master’s in Computer Science or related discipline

Tools

Apache Spark

Cloudera CDP (Hive, HDFS, HBase, Impala/Trino)

Kafka

Airflow

Job description

A tech firm specializing in financial solutions is seeking a Data Engineer for a 6-month contract in Singapore. The role involves supporting high-priority data initiatives, focusing on building and maintaining robust data pipelines. Ideal candidates will have extensive experience in Apache Spark and Cloudera, with responsibilities including designing pipelines, data validation, and cross-functional collaboration. Join a dynamic team dedicated to enhancing AI-driven financial crime prevention efforts.