Staff Software Engineer, OTA Services

horizon3ai; United States; Remote; USD 180,000 - 240,000; Full time

Benefits offered by this job

Health insurance

Vision coverage

Dental coverage

Flexible vacation

Parental leave

Possible equity

Job summary

horizon3ai is seeking a hands-on staff-level software engineer to design and operate the systems that deliver updates to containerized deployments across customer-managed environments. You will own update safety, fleet visibility, version negotiation, rollout controls, health checks, and recovery while guiding engineers and setting technical direction.

This remote role requires eight+ years of experience in distributed systems, Go, Python, or Rust, and the ability to work across air-gapped

Qualifications

• 8+ years of software engineering experience with distributed systems, remote updates, or fleet management infrastructure.
• Strong understanding of update delivery, version negotiation, health checks, and rollback behavior.
• Experience rolling out software to heterogeneous, customer-managed production environments at scale.
• Proficiency in Go, Python, or Rust for systems infrastructure work.

Responsibilities

• Design the update system, including delivery protocols, version negotiation, rollout orchestration, health verification, and automatic rollback.
• Track deployment versions and identify updates that are pending, stalled, or out of sync.
• Build safe rollout controls such as phased releases, canaries, customer version pinning, and emergency holds.
• Make update delivery work in restricted and air-gapped networks and other constrained environments.
• Own reliability and incident response for delivery failures, stuck updates, and version drift.
• Write production code, guide architecture, and mentor engineers through reviews and technical pairing.

Skills

Distributed systems

Remote updates

Fleet management

Go

Python

Rust

Job description

Role overview

Design and operate the systems that deliver software updates to containerized deployments across diverse customer-managed environments. This hands-on staff-level role owns update safety and fleet visibility, from version negotiation and rollout controls to health checks and recovery, while setting technical direction and mentoring engineers.

Responsibilities

• Design the update system, including delivery protocols, version negotiation, rollout orchestration, health verification, and automatic rollback.
• Track deployment versions and identify updates that are pending, stalled, or out of sync.
• Build safe rollout controls such as phased releases, canaries, customer version pinning, and emergency holds.
• Make update delivery work in restricted and air-gapped networks and other constrained environments.
• Own reliability and incident response for delivery failures, stuck updates, and version drift.
• Write production code, guide architecture, and mentor engineers through reviews and technical pairing.

Requirements

• At least eight years of software engineering experience, with deep specialization in distributed systems, remote updates, or fleet management infrastructure.
• Strong understanding of update delivery, version negotiation, health checks, and rollback behavior.
• Experience rolling out software to heterogeneous, customer-managed production environments at scale.
• Proficiency in Go, Python, or Rust for systems infrastructure work.
• Ability to design for constrained or air-gapped deployments and take ownership of production reliability.

Benefits and work setup

The role is remote and requires a minimum 25 Mbps broadband connection. Listed benefits include health, vision, and dental coverage, flexible vacation, parental leave, and possible equity. Compensation depends on location, qualifications, experience, and skills.