Senior Fault Tolerance Design Specialist

Green Earth Resilience Foundation; United Arab Emirates; Remote; AED 250,000 - 450,000; Full time

Benefits offered by this job

Remote work

Flexible coordination across teams

Job summary

Green Earth Resilience Foundation seeks an experienced Senior Fault Tolerance Design Specialist to design, implement, and improve resilient systems that stay operational during failures. You will develop fault-tolerant architectures, strengthen reliability, and establish recovery mechanisms to support business continuity.

You will identify failure points, design redundancy, run chaos experiments, and collaborate with cross-functional teams to meet RTOs and RPOs while maintaining comprehensive

Qualifications

• Bachelor's degree in CS/Engineering or related field.
• 5–8 years in software architecture, distributed systems, or fault-tolerant design.
• Strong understanding of distributed computing, redundancy, failover and recovery.
• Experience designing highly available systems across cloud, hybrid, or on‑prem.
• Familiar with AWS, Azure or Google Cloud.
• Knowledge of containers, orchestration, infrastructure automation and observability tools.
• Experience with fault-injection testing, chaos engineering and disaster recovery.
• Strong analytical, troubleshooting, communication and problem-solving skills.

Responsibilities

• Design and implement fault-tolerant architectures for distributed systems and critical infrastructure.
• Identify single points of failure and mitigate operational risks.
• Develop redundancy, failover, replication and automated recovery mechanisms.
• Establish resilience patterns including retries, timeouts, circuit breakers, bulkheads, graceful degradation.
• Conduct failure-mode analysis and reliability assessments.
• Perform fault-injection experiments and controlled failure simulations.
• Collaborate with engineers, DevOps, SREs, and infra teams to improve robustness.
• Define RTOs, RPOs, and fault-tolerance requirements.
• Investigate incidents and implement corrective measures.
• Maintain architecture standards and disaster recovery procedures.

Skills

Fault tolerance

Distributed systems

Chaos engineering

Incident analysis

Root cause analysis

Observability

Automation

SRE collaboration

Education

Bachelor's degree

Tools

Docker

Kubernetes

Terraform

CI/CD

Monitoring tools

Job description

Job Title: Senior Fault Tolerance Design Specialist

Location: United Arab Emirates (Remote)

Employment Type: Full-Time

Work Arrangement: 100% Remote — Work From Home

About the Role

We are seeking an experienced Senior Fault Tolerance Design Specialist to design, implement, and improve resilient systems that continue operating during failures and unexpected disruptions. The successful candidate will develop fault-tolerant architectures, strengthen system reliability, reduce service interruptions, and establish effective recovery mechanisms to support business continuity and operational stability.

Key Responsibilities

• Design and implement fault-tolerant architectures for distributed systems, applications, and critical infrastructure.
• Identify single points of failure and develop strategies to eliminate or mitigate operational risks.
• Develop redundancy, failover, replication, and automated recovery mechanisms.
• Establish resilience patterns, including retries, timeouts, circuit breakers, bulkheads, and graceful degradation.
• Conduct failure-mode analysis, reliability assessments, and system resilience reviews.
• Design and execute fault-injection experiments and controlled failure simulations to evaluate system behavior.
• Collaborate with software engineers, DevOps teams, site reliability engineers, and infrastructure specialists to improve system robustness.
• Define reliability objectives, recovery time objectives (RTOs), recovery point objectives (RPOs), and fault-tolerance requirements.
• Investigate incidents, identify root causes, and implement corrective and preventive measures.
• Maintain technical documentation, architecture standards, resilience guidelines, and disaster recovery procedures.

Qualifications and Experience

• Bachelor's degree in Computer Science, Software Engineering, Computer Engineering, or a related technical discipline.
• At least 5–8 years of experience in software architecture, distributed systems, reliability engineering, or fault-tolerant system design.
• Strong understanding of distributed computing, redundancy, replication, failover, and failure recovery principles.
• Experience designing highly available systems across cloud, hybrid, or on-premises environments.
• Familiarity with cloud platforms such as AWS, Microsoft Azure, or Google Cloud.
• Knowledge of containerization, orchestration, infrastructure automation, and observability tools.
• Experience with fault-injection testing, chaos engineering, incident analysis, and disaster recovery planning.
• Strong analytical, troubleshooting, communication, and problem-solving skills.
• Ability to work independently, collaborate with distributed teams, and communicate complex technical concepts clearly.

What We Offer

• Competitive compensation based on qualifications and professional experience.
• A 100% remote working arrangement with flexible coordination across distributed teams.
• Opportunities to contribute to critical reliability and resilience initiatives.
• A collaborative environment that supports technical development and continuous improvement.