Big Data Platform SRE Engineer

Tencent; Singapore; On-site; SGD 70,000 - 110,000; Full time

Benefits offered by this job

Datacenter access

Job summary

Tencent is seeking an experienced engineer to support and operate its overseas big data platforms. You will monitor health, handle user issues, and work with a team to improve workflows and tooling.

The role emphasizes hands-on data platform management, incident documentation, and contributing to cost-efficiency by evaluating new technologies.

Qualifications

• Hands-on experience with big data technologies.
• Knowledge of Hadoop, YARN, Flink, Spark, HDFS, Presto, or Hive.
• Shell proficiency and Java/Python/Go basics.
• Solid Linux/Unix fundamentals and log-based troubleshooting.
• Troubleshooting mindset to decompose and resolve issues.

Responsibilities

• Support day-to-day operation and maintenance of Tencent's overseas big data platforms.
• Monitor platform health and escalate anomalies.
• Serve as first point of contact for user issues and drive resolutions.
• Review operational workflows and propose improvements.
• Build and maintain internal tools for automation and monitoring.
• Contribute to cost-optimization initiatives and evaluate new tech.
• Document incidents, resolutions, and runbooks.

Skills

Big data experience

Hadoop

YARN

Flink

Spark

HDFS

Presto

Hive

Shell

Java

Python

Go

Linux basics

Troubleshooting

Prometheus

Grafana

ELK

Airflow

Ansible

Kubernetes

Databricks

Snowflake

EMR

Tools

Prometheus

Grafana

ELK

Airflow

Ansible

Kubernetes

Databricks

Snowflake

EMR

Job description

What We Look For

• Support the day-to-day operation and maintenance of Tencent's overseas big data platforms and clusters under the guidance of senior engineers; Help monitor platform health and elevate anomalies.
• Act as a first point of contact for user issues — platform usage, component errors, and basic performance problems — and work with senior engineers to drive them to resolution.
• Participate in reviewing existing operational workflows and standards; identify pain points and contribute improvement ideas.
• Assist in building and maintaining internal operational efficiency tools: capacity management, DevOps pipelines, coverage analytics, automation scripts, and health monitoring.
• Contribute to cluster cost-optimization initiatives, e.g. helping evaluate new technologies or architectures and measuring their impact on processing efficiency and cost.
• Document incidents, resolutions and runbooks to build up the team's shared knowledge base.

Must-have

• Some hands-on experience with big data technologies.
• Working knowledge of at least one of the following: Hadoop, YARN, Flink, Spark, HDFS, Presto, Hive — plus a genuine willingness to go deep on the rest.
• Basic proficiency in Shell and at least one of the following languages: Java / Python / Go.
• Solid Linux/Unix fundamentals: Comfortable on the command line, able to do basic performance observation and log-based troubleshooting.
• A troubleshooting mindset — you can break a problem down, search, ask, and iterate rather than getting stuck.

Nice to have

• Exposure to mainstream big data or cloud data platforms (e.g. Databricks, Snowflake, EMR).
• Coursework or projects in distributed systems, databases, or cloud infrastructure.
• Familiarity with observability tooling (Prometheus, Grafana, ELK) or orchestration/automation (Airflow, Ansible, Kubernetes).
• Any exposure to on-call or production incident handling.