Senior Big Data SRE: Reliability, Observability & Automation

Shopee; Singapore; On-site; SGD 90,000 - 150,000; Full time

Job summary

Shopee in Singapore is seeking a Big Data Site Reliability Engineer to deploy, operate, and scale large data platforms with focus on availability and performance. You will own monitoring, incident response, troubleshooting, and capacity planning for critical data services.

Collaborating with engineering, data, and infrastructure teams, you will drive observability, automate repetitive tasks, and improve contingency plans and post‑incident reviews to reduce MTTR.

Qualifications

• Bachelor’s degree or higher in Computer Science, Software Engineering, or related fields.
• At least one year of experience in big data SRE, platform operations, or production support.
• Familiarity with the Hadoop ecosystem and hands‑on experience with HDFS, YARN, Spark, Flink, Hive, Presto/Trino, Kafka, HBase, or ClickHouse.
• Solid knowledge of Linux systems and operations tools, with monitoring, troubleshooting, performance tuning, and capacity planning.
• Hands‑on experience handling production incidents in big data environments with structured troubleshooting.
• Proficiency in at least one language (Shell, Python, Java, or Scala) for tooling and automation.
• Understanding of high availability, disaster recovery, observability, change management, and SRE practices.
• Strong communication, collaboration, and cross-functional coordination skills.

Responsibilities

• Deploy, operate, and maintain big data platforms, continuously improving their availability, reliability, scalability, and operational efficiency.
• Own monitoring, alerting, incident response, troubleshooting, performance optimization, and capacity planning for big data services and platforms.
• Build and improve platform observability capabilities, including metrics, logging, tracing, dashboards, and alert management.
• Turn operational knowledge and repetitive tasks into documentation, tools, automation, and standardized processes.
• Establish and continuously improve incident response procedures, contingency plans, and post-incident review practices to reduce failure rates and mean time to recovery.
• Collaborate with engineering, data, and infrastructure teams to optimize platform architecture and ensure production reliability and operational safety.

Skills

Strong communication

Collaboration

Cross-functional coordination

Education

Bachelor's degree in Computer Science, Software Engineering, or related fields

Tools

HDFS

YARN

Spark

Flink

Hive

Presto/Trino

Kafka

HBase

ClickHouse

Linux

Monitoring tools

Job description

Shopee in Singapore is seeking a Big Data Site Reliability Engineer to deploy, operate, and scale large data platforms with focus on availability and performance. You will own monitoring, incident response, troubleshooting, and capacity planning for critical data services.

Collaborating with engineering, data, and infrastructure teams, you will drive observability, automate repetitive tasks, and improve contingency plans and post‑incident reviews to reduce MTTR.