Real-Time Data Platform Engineer

BYTEDANCE PTE. LTD.; Singapore; On-site; SGD 90,000 - 150,000; Full time

Job summary

BYTEDANCE PTE. LTD. invites a data engineer to join a team building the data management suite. You will design, develop, and optimize large-scale data ingestion systems supporting real-time pipelines, with focus on throughput, latency, and fault tolerance.

You will work with Hadoop, Flink, and Kafka to enhance performance, reliability, and monitoring across data platforms used by hundreds of millions of users. A collaborative, cross-functional environment is expected to drive scalable solutions.

Qualifications

• Bachelor's degree in Computer Science or equivalent practical experience.
• 2+ years of software development with Java/Scala/Python/Go proficiency.
• Strong understanding of data structures, algorithms, and distributed systems.
• Hands-on experience with big data technologies such as Hadoop, Flink, Kafka.
• 2+ years real-time data processing experience, e.g., Flink.
• Open-source contributions are a plus.
• Experience in event tracking, real-time processing, governance and cost optimization.
• Deep understanding of data lakehouse architectures and stream/batch integration.
• Strong problem-solving skills and collaborative mindset.

Responsibilities

• Design, develop, and optimize large-scale data ingestion systems for real-time pipelines.
• Enhance performance, scalability, and reliability of data ingestion workflows.
• Develop automated operation and maintenance systems to monitor and diagnose pipelines.
• Collaborate with cross-functional teams on event data ingestion, transformation, and storage.
• Troubleshoot production issues to minimize downtime and improve performance.

Skills

Java

Python

Scala

Go

Education

Bachelor's degree in Computer Science

Tools

Hadoop

Flink

Kafka

Job description

BYTEDANCE PTE. LTD. invites a data engineer to join a team building the data management suite. You will design, develop, and optimize large-scale data ingestion systems supporting real-time pipelines, with focus on throughput, latency, and fault tolerance.

You will work with Hadoop, Flink, and Kafka to enhance performance, reliability, and monitoring across data platforms used by hundreds of millions of users. A collaborative, cross-functional environment is expected to drive scalable solutions.