Runtime Systems Engineer - AI Agents at Scale (Hybrid)

Candidate; Mountain View (CA); Hybrid; USD 180,000 - 210,000; Full time

Benefits offered by this job

Home office stipend

Annual education stipend

Wellbeing stipend

Lunches provided

Job summary

Glean is hiring for the Agentic Runtime team in Mountain View. You will design and operate core runtime services for multi-turn orchestration, tool calling, model routing, memory, streaming, and safety, building reliable cloud-native systems.

You will collaborate with product, quality, and infra teams to deliver low-latency, scalable experiences, optimize performance and cost, and ensure observability and on-call readiness across Kubernetes and major cloud platforms.

Qualifications

• 3+ years of software engineering experience building production distributed systems or cloud-native applications.
• BS/BA in Computer Science or related field, or equivalent practical experience.
• Strong coding skills in Python, Go, Java, Javascript, Typescript, or C++, with a focus on reliability, performance, and tests.

Responsibilities

• Own impactful runtime problems end-to-end — from architecture and design to production launch and ongoing reliability.
• Build and evolve core services for session lifecycle, streaming responses, structured tool execution, memory/state, and policy/guardrails.
• Design for performance, correctness, and cost: reduce latency, improve tail behavior, and optimize budgets.
• Integrate with leading LLM providers and internal evaluation frameworks to improve quality and predictability.
• Harden the platform with fault isolation, retries, timeouts, circuit-breaking, backpressure, and graceful degradation.
• Instrument observability and create playbooks/SLOs for high availability and on-call excellence.
• Collaborate with product, quality, and application teams to prioritize roadmap investments.

Skills

Python

Go

Java

JavaScript

TypeScript

C++

Education

BS/BA in Computer Science or related field

Tools

Kubernetes

GCP

AWS

Azure

Redis

Pub/Sub

Kafka

Job description

Glean is hiring for the Agentic Runtime team in Mountain View. You will design and operate core runtime services for multi-turn orchestration, tool calling, model routing, memory, streaming, and safety, building reliable cloud-native systems.

You will collaborate with product, quality, and infra teams to deliver low-latency, scalable experiences, optimize performance and cost, and ensure observability and on-call readiness across Kubernetes and major cloud platforms.