Real-Time Data Platform Engineer

Vidaa; Singapore; On-site; SGD 90,000 - 130,000; Full time

Job summary

Vidaa in Singapore seeks an experienced Big Data Engineer to own the real-time data ingestion system end-to-end, including collection, cleaning, and warehousing of business logs, user behavior, and operational data. You will design multi-layer real-time data models and streaming ETL pipelines to support real-time metrics, dashboards, and monitoring.

You will collaborate with data analysts, product managers, and overseas teams, focusing on data quality, pipeline stability, and performance tuning

Qualifications

• 3+ years of professional big data development experience in internet industry.
• End-to-end real-time data warehouse implementation and data ingestion system construction.
• Proficient in English reading, writing and verbal communication.

Responsibilities

• Own construction and maintenance of the company’s real-time data ingestion system.
• Lead real-time data warehouse architecture design and streaming ETL pipelines.
• Collaborate with business teams, data analysts, and product managers to decompose data requirements and implement solutions.
• Maintain and optimize Kafka streaming pipelines for real-time ingestion and consumption.
• Develop, tune, and operate Spark real-time tasks and optimize latency and throughput.
• Contribute to data standardization, real-time data quality governance, and best practices.

Skills

English communication

Team collaboration

Overseas collaboration

Education

Bachelor's degree in CS/Software Engineering/Data Science

Tools

Kafka

Spark

Flink

BigQuery

DBT

Databricks

Python

Scala

Java

Linux

Job description

Vidaa in Singapore seeks an experienced Big Data Engineer to own the real-time data ingestion system end-to-end, including collection, cleaning, and warehousing of business logs, user behavior, and operational data. You will design multi-layer real-time data models and streaming ETL pipelines to support real-time metrics, dashboards, and monitoring.

You will collaborate with data analysts, product managers, and overseas teams, focusing on data quality, pipeline stability, and performance tuning