Senior Big Data Platform SRE Engineer

Tencent; Singapore; On-site; SGD 90,000 - 150,000; Full time

Job summary

Tencent is seeking an experienced Big Data Operations professional to oversee the operation and maintenance of overseas big data platforms, ensuring platform and cluster stability. You will assist users with platform usage issues, optimize workflows, and develop efficiency tools to improve DevOps practices.

The role emphasizes hands-on performance tuning, troubleshooting, and cost-optimisation across large-scale data clusters. Singapore-based position with international impact.

Qualifications

• 3+ years of big data operation/development experience.
• Proficient in ≥2 of the listed big data technologies.
• Strong knowledge of Linux/Unix OS and performance tuning.

Responsibilities

• Oversee the operation and maintenance of Tencent's overseas big data platforms to ensure platform and cluster stability.
• Assist users in resolving issues related to big data platform usage, including platform operations, component errors, and performance optimisation.
• Optimise existing service workflows, standards, and pain points, and propose actionable solutions.
• Develop front-end/back-end operational efficiency tools, including capacity management platforms, DevOps frameworks, coverage analytics, automation systems, and health monitoring.
• Optimise big data cluster costs by implementing new technologies or architectures to improve processing efficiency and reduce operational expenses.

Skills

HDFS

YARN

Flink

Spark

Presto

Hive

HBase

StarRocks

Java

Python

Golang

Linux/Unix

Performance tuning

Troubleshooting

Job description

• Oversee the operation and maintenance of Tencent's overseas big data platforms to ensure platform and cluster stability.
• Assist users in resolving issues related to big data platform usage, including but not limited to platform operations, component errors, and performance optimisation.
• Optimise existing service workflows, standards, and pain points, and propose actionable solutions.
• Develop front-end/back-end operational efficiency tools, including but not limited to: capacity management platforms, DevOps frameworks, coverage analytics, automation systems, and health monitoring.
• Optimise big data cluster costs by implementing new technologies or architectures to improve processing efficiency and reduce operational expenses.

Who We Look For

• Proficient in ≥2 of these big data technologies: HDFS, YARN, Flink, Spark, Presto, Hive, HBase, StarRocks.
• Skilled in ≥1 programming language (Java/Python/Golang, etc.).
• Expertise in Linux/Unix OS, system performance tuning, and failure resolution.
• ≥3 years of big data operation/development experience, with strong troubleshooting skills, technical sensitivity, and risk identification capabilities.
• Knowledge of mainstream big data platforms (e.g., Databricks, Snowflake) will be considered a strong plus.