Foundations Engineer: Real-Time AI Infrastructure

Rox; San Francisco, Northern (CA, KY); Hybrid; USD 190,000 - 270,000; Full time

Job summary

Rox is hiring a Foundations Engineer (Deep Infra) to design and operate the systems powering Rox’s agent runtime. You will work at the intersection of distributed systems, real-time data infrastructure, and agent orchestration to enable continuous AI decision loops.

The role focuses on building reliable, fast, observable infrastructure and execution frameworks for long-running agent workflows, collaborating with product and field engineers to deliver real customer impact.

Qualifications

• Experience building deep infrastructure systems in production.
• Proficiency with distributed data platforms, streaming compute, and real-time analytics infrastructure.
• Strong latency, reliability, and scalability tradeoff intuition.
• Ability to debug complex distributed systems in production.
• Bias toward shipping systems and improving them from production.

Responsibilities

• Design and build core distributed systems powering Rox agents.
• Build infra for real-time context ingestion and retrieval.
• Develop systems enabling low-latency agent decisioning at scale.
• Improve reliability, observability, and fault tolerance across agent infrastructure.
• Build execution frameworks for long-running agent workflows.
• Collaborate with product and forward deployed engineers to translate infra capabilities into customer impact.
• Ship production systems quickly and iterate based on usage.

Skills

Distributed systems

Real-time data infra

Latency optimization

Observability

Production debugging

Tools

Distributed data platforms

Streaming compute

Real-time analytics infra

Distributed query engines

Backend services

Job description

Rox is hiring a Foundations Engineer (Deep Infra) to design and operate the systems powering Rox’s agent runtime. You will work at the intersection of distributed systems, real-time data infrastructure, and agent orchestration to enable continuous AI decision loops.

The role focuses on building reliable, fast, observable infrastructure and execution frameworks for long-running agent workflows, collaborating with product and field engineers to deliver real customer impact.