Contract Big Data Engineer - Real-Time Platform Lead

QUESSCORP SINGAPORE PTE. LTD.; Singapore; On-site; SGD 150,000 - 190,000; Full time

Job summary

QUESSCORP SINGAPORE PTE. LTD. is seeking a senior data engineering leader to architect and operate scalable data warehouses and streaming pipelines.

You will own the end-to-end data platform, manage multi-cluster resources, and ensure secure access with audit trails. Build real-time data services with strict latency and availability targets while guiding engineers and collaborating with product teams. You will design ingestion pipelines for external sources, define data models and feature

Qualifications

• Bachelor's degree in Computer Science, Information and Computing Science, Mathematics, Statistics or related field.
• At least 8 years of professional software or data engineering experience, incl 4+ years building big data platforms.
• Hands-on production with Flink for real-time processing; Hive, HDFS and YARN experience.
• Proven experience designing multi-tenant data platforms with resource management, permissions, auditing and authentication.
• Strong Java (Spring / Spring Cloud); Python/Scala/Go knowledge is a plus.
• Strong SQL skills with MySQL, TiDB or similar databases.
• Experience building real-time data services for transactional/financial data.
• Track record of improving reliability via monitoring, fault drills and failover design.
• Solid data modelling, ETL/ELT, batch and streaming architectures knowledge.
• Ability to evaluate trade-offs and mentor engineers.

Responsibilities

• Lead architecture and development of scalable data warehouses and pipelines (Flink and Hive/HDFS).
• Own end-to-end design and operation of a big data platform with multi-cluster management.
• Build and maintain real-time data services with strict accuracy and latency targets.
• Design reliable ingestion systems for external data sources with fallbacks.
• Define data models, tagging systems and feature datasets for segmentation.
• Establish data quality, observability, monitoring and governance dashboards.
• Plan fault drills and stress tests to reduce operational risk.
• Improve processing performance, resource efficiency and platform stability.
• Provide technical guidance, conduct reviews, and mentor engineers.
• Collaborate with business/product/engineering to translate requirements into solutions.

Skills

Big data platforms

Flink real-time

Java (Spring)

SQL & distributed DBs

System reliability

Architecture decisions

Code reviews & mentoring

ETL/ELT, data modeling

Multi-tenant platforms

Python/Scala/Go knowledge

Education

Bachelor's degree in CS/related field

Tools

Hive/HDFS/YARN

Spark

Kafka

Trino

Redis

gRPC

Job description

QUESSCORP SINGAPORE PTE. LTD. is seeking a senior data engineering leader to architect and operate scalable data warehouses and streaming pipelines.

You will own the end-to-end data platform, manage multi-cluster resources, and ensure secure access with audit trails. Build real-time data services with strict latency and availability targets while guiding engineers and collaborating with product teams. You will design ingestion pipelines for external sources, define data models and feature