Foundations Engineer — Real-Time AI Agent Infrastructure

Rox; San Francisco (CA); On-site; USD 180,000 - 270,000; Full time

Job summary

Rox in San Francisco is looking for a Foundations Engineer (Deep Infra) to design and operate the systems powering Rox's agent runtime. You will build core distributed systems powering Rox agents, enabling real-time context ingestion and retrieval, and developing low-latency decisioning at scale.

This role emphasizes reliability, observability, and collaboration with product engineers to translate infrastructure capabilities into customer impact.

Qualifications

• Experience building deep infrastructure systems in production.
• Strong intuition for latency, reliability, and scalability tradeoffs.
• Experience operating systems where real-world traffic exposes edge cases quickly.
• Comfort debugging complex distributed systems in production.
• A bias toward shipping systems, learning from production, and improving them continuously.

Responsibilities

• Design and build core distributed systems powering Rox agents.
• Build infrastructure for real-time context ingestion and retrieval.
• Develop systems that enable low-latency agent decisioning at scale.
• Improve reliability, observability, and fault tolerance across agent infrastructure.
• Build execution frameworks that support long-running agent workflows.
• Collaborate closely with product engineers and forward deployed engineers to translate infrastructure capabilities into customer impact.
• Ship production systems quickly and evolve them based on real-world usage.

Skills

Distributed systems

Real-time infra

Latency optimization

Observability

Tools

Distributed query engines

Streaming compute systems

Real-time analytics infra

Job description

Rox in San Francisco is looking for a Foundations Engineer (Deep Infra) to design and operate the systems powering Rox's agent runtime. You will build core distributed systems powering Rox agents, enabling real-time context ingestion and retrieval, and developing low-latency decisioning at scale.

This role emphasizes reliability, observability, and collaboration with product engineers to translate infrastructure capabilities into customer impact.