Senior Real-Time Data Engineer — Streaming & Storage

BYTEDANCE PTE. LTD.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

ByteDance seeks engineers to craft and deploy real-time data systems for a billion-user recommendation platform. You will design scalable storage and compute models, troubleshoot production failures, and build distributed streaming frameworks to support massive data needs in the ads, search and recommendation domains.

You will analyze user needs, apply rigorous CS/engineering methods, and drive software updates, testing and validation.

Qualifications

• Proficient in Java, C++, Scala, Python.
• Strong coding and troubleshooting skills.
• At least 3 years of relevant experience.
• Deep understanding of streaming computing systems with production TB-level Flink.
• Familiar with Flink modules and data lake tech (Hudi/Iceberg/DeltaLake).
• Willing to learn and tackle hard problems.

Responsibilities

• Design and implement real-time data systems for large-scale recommendations.
• Create scalable, stable storage and compute models.
• Troubleshoot production failures; ensure production stability.
• Build streaming frameworks and distributed infrastructure for massive data.
• Research, design and develop software and utilities.
• Analyze user needs and craft software solutions using CS/engineering methods.
• Update software and drive testing/validation procedures.
• Collaborate with hardware teams to integrate HW/SW and set specs.

Skills

Java

C++

Scala

Python

3+ years exp

Flink streaming

FlinkDataStream

FlinkSQL

FlinkCheckpoint

FlinkState

Data lake

Hudi

Iceberg

DeltaLake

YARN

Kubernetes

Spark

Kudu

RocksDB

Reading code

Tools

FlinkDataStream

FlinkSQL

FlinkCheckpoint

FlinkState

Hudi

Iceberg

DeltaLake

YARN

Kubernetes

Spark

Kudu

RocksDB

Job description

ByteDance seeks engineers to craft and deploy real-time data systems for a billion-user recommendation platform. You will design scalable storage and compute models, troubleshoot production failures, and build distributed streaming frameworks to support massive data needs in the ads, search and recommendation domains.

You will analyze user needs, apply rigorous CS/engineering methods, and drive software updates, testing and validation.