Big Data Platform SRE: Scale & Reliability

Tencent; Singapore; On-site; SGD 90,000 - 130,000; Full time

Job summary

Tencent's Technology Engineering Group (TEG) is seeking a practical Big Data Operations engineer to oversee overseas platforms, ensure cluster stability, and assist users across regions from Singapore.

You will drive automation, develop efficiency tools, and optimize costs by applying expertise in HDFS, Spark, Flink, and Linux to keep services running smoothly and securely, with a focus on DevOps and health monitoring.

Qualifications

• Experience operating overseas big data platforms.
• Ability to resolve platform usage issues and optimize performance.
• Experience optimizing service workflows and standards.
• Familiarity with DevOps workflows and monitoring tools.

Responsibilities

• Oversee the operation and maintenance of Tencent's overseas big data platforms to ensure platform and cluster stability.
• Assist users in resolving issues related to big data platform usage, including but not limited to platform operations, component errors, and performance optimisation.
• Optimise existing service workflows, standards, and pain points, and propose actionable solutions.
• Develop front-end/back-end operational efficiency tools, including but not limited to: capacity management platforms, DevOps frameworks, coverage analytics, automation systems, and health monitoring.
• Optimise big data cluster costs by implementing new technologies or architectures to improve processing efficiency and reduce operational expenses.

Skills

HDFS

YARN

Flink

Spark

Presto

Hive

HBase

StarRocks

Java

Python

Golang

Linux/Unix

Performance tuning

Troubleshooting

Databricks

Snowflake

Job description

Tencent's Technology Engineering Group (TEG) is seeking a practical Big Data Operations engineer to oversee overseas platforms, ensure cluster stability, and assist users across regions from Singapore.

You will drive automation, develop efficiency tools, and optimize costs by applying expertise in HDFS, Spark, Flink, and Linux to keep services running smoothly and securely, with a focus on DevOps and health monitoring.