Distributed Systems Engineer - Remote, Equity, Growth

HushOne, Inc.; Kirkland (WA); Hybrid; USD 140,000 - 210,000; Full time

Benefits offered by this job

Stock options

Annual bonus

Health insurance

401(k) with match

Gym membership

Job summary

HushOne, Inc. seeks a systems engineer to design and implement durable task state, queues, leases, and reconciliation across a distributed setup. You will craft failover that prevents duplicate authority and clearly separate control-plane replication from execution workers.

You will also emphasize handling partial failures, explaining the chosen consistency model to implementers and demonstrating real-world failure guarantees. This role values rigorous reasoning and practical, testable outcomes.

Qualifications

• Strong reasoning about consistency, retries, failure detection, and distributed transactions.
• Operated a system through real failures and can say what guarantees it provided.
• Design for partial failure as the normal case.
• Explain a consistency model to someone who will implement against it.

Responsibilities

• Build durable task state, queues, leases, fencing, cancellation and reconciliation.
• Design failover so a recovered replica cannot become a second conflicting authority.
• Differentiate control-plane replication from execution workers and expose uncertainty when external outcomes cannot be confirmed.

Skills

Consistency modeling

Retry logic

Failure detection

Distributed transactions

System design

Explainable models

Tools

Consensus protocols

Formal methods

Job description

HushOne, Inc. seeks a systems engineer to design and implement durable task state, queues, leases, and reconciliation across a distributed setup. You will craft failover that prevents duplicate authority and clearly separate control-plane replication from execution workers.

You will also emphasize handling partial failures, explaining the chosen consistency model to implementers and demonstrating real-world failure guarantees. This role values rigorous reasoning and practical, testable outcomes.