Senior Principal Chaos Engineer, Platform & Resilience

Bybit Limited

Hong Kong

On-site

HKD 1,200,000 - 2,000,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Bybit is seeking a Senior Chaos/Resilience Engineer to design and operate an enterprise-grade chaos engineering platform across multi-cluster, multi-region deployments. You will own fault-injection tooling, safety controls, and automated recovery, partnering with SRE and platform teams to raise resilience across the production stack.

You will mentor 2–3 engineers, stay ahead of industry trends, and define playbooks for incident injection, monitoring, and SLO alignment.

Qualifications

  • 8+ years backend/infrastructure engineering experience, with 3+ years in chaos or stability engineering.
  • Hands-on experience with large-scale fault injection in production environments.
  • Expert-level Kubernetes fault injection (Chaos Mesh / Litmus / custom solutions), familiar with CRD/Operator development.
  • Proficient in Go (or other backend language) with architecture design capability.
  • Deep understanding of distributed system failure modes.
  • Familiarity with observability stacks (Prometheus / Grafana / OpenTelemetry).
  • Excellent technical documentation and solution design skills.

Responsibilities

  • Design and build an enterprise-grade chaos engineering platform across multi-cluster, multi-region deployments.
  • Develop fault injection engine and safety controls for production environments.
  • Production safety: blast radius control, one-click Kill Switch, automated rollback, real-time impact monitoring.
  • Integrate with monitoring and SLO systems to automate fault observation and pass/fail decisions.
  • Mentor 2–3 engineers in chaos engineering and stay current with industry practices (AI-driven fault scenarios).
  • Collaborate with SREs and developers to improve system resilience across services.

Skills

Kubernetes
Chaos engineering
Go language
Observability
Documentation
Leadership

Tools

Chaos Mesh
Litmus
OpenTelemetry
Prometheus
Grafana
AWS

Job description

Bybit is seeking a Senior Chaos/Resilience Engineer to design and operate an enterprise-grade chaos engineering platform across multi-cluster, multi-region deployments. You will own fault-injection tooling, safety controls, and automated recovery, partnering with SRE and platform teams to raise resilience across the production stack.

You will mentor 2–3 engineers, stay ahead of industry trends, and define playbooks for incident injection, monitoring, and SLO alignment.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Principal Site Reliability Engineer
Senior Principal Site Reliability Engineer

Bybit Limited • Hong Kong

On-site
HKD 1,200,000 - 2,000,000
Application Reliability Engineer
Application Reliability Engineer

IO Tech Solutions Limited • Hong Kong

On-site
HKD 900,000 - 1,500,000
Java Backend Observability & Stability Engineer
Java Backend Observability & Stability Engineer

Bybit Limited • Hong Kong

On-site
HKD 360,000 - 720,000
Study Growth Fund
Internal Events
Global Collaboration
+2
Sr. Manager, Site Reliability & Innovation, IT
Sr. Manager, Site Reliability & Innovation, IT

CITIC Securities International • Hong Kong

On-site
HKD 1,000,000 - 2,000,000
Senior SRE & Platform Engineer — Reliability & Observability
Senior SRE & Platform Engineer — Reliability & Observability

Kody • Hong Kong

On-site
HKD 900,000 - 1,500,000
Senior Site Reliability Engineer - FinTech Platform Hybrid
Senior Site Reliability Engineer - FinTech Platform Hybrid

GFT Technologies SE • Hong Kong

Hybrid
HKD 900,000 - 1,300,000
Lead Red Team Security Operations Engineer
Lead Red Team Security Operations Engineer

Bybit Limited • Hong Kong

On-site
HKD 900,000 - 1,500,000
Study Growth Fund
Internal Events
Global Collaboration
+2
Senior SRE & DevOps Lead for Fintech Platform
Senior SRE & DevOps Lead for Fintech Platform

Captar Partners Ltd • Hong Kong

On-site
HKD 900,000 - 1,200,000
Head of Infrastructure SRE
Head of Infrastructure SRE

Red Begonia Limited • Hong Kong Island

On-site
HKD 600,000 - 1,000,000
SRE Platform Engineer
SRE Platform Engineer

Gravitas Recruitment Group Hong Kong • Hong Kong

On-site
HKD 600,000 - 1,000,000