Senior AI Infra Agent Systems Engineer

Together Computer Inc; United States; Remote; USD 250,000 - 300,000; Full time

Benefits offered by this job

Health insurance

Equity + benefits

Remote-friendly

Job summary

Together AI is building a new era of autonomous AI infrastructure. This role focuses on production backend systems for AI agents that diagnose failures, investigate incidents, and automate remediation at scale across our large GPU fleet.

You'll own core platform components—knowledge graphs, retrieval, orchestration, and tooling—enabling agents to reason, act, and continuously improve within a distributed ecosystem. This is a hands-on, impact-driven opportunity.

Qualifications

• 5+ years of experience building production backend systems, distributed systems, or infrastructure platforms.
• Strong systems design skills and experience owning significant systems from design through production.
• Depth in AI agent systems, knowledge graphs, search/retrieval/ranking, or graph data modeling.
• Strong backend engineering experience including API design, service boundaries, data modeling, and integrations.

Responsibilities

• Design and build production AI agent systems that diagnose, investigate, and remediate infrastructure issues across one of the world’s largest GPU fleets.
• Build the distributed services, orchestration framework, knowledge graph, and retrieval systems that power infrastructure agents.
• Develop fleet intelligence systems that combine telemetry, infrastructure state, operational knowledge, and historical incidents to help agents make better decisions.
• Integrate with observability, incident management, ticketing, fleet inventory, source control, chat, and internal infrastructure systems through well-designed APIs.
• Own services end to end, including architecture, implementation, testing, deployment, observability, and production operations.
• Improve agent performance through evaluations, retrieval improvements, better tools, and production feedback loops.
• Turn what agents learn in production into reliable, reviewed software and automation.

Skills

Backend engineering

API design

Kubernetes

GitOps

Go

TypeScript

Python

Rust

Distributed systems

Knowledge graphs

Prometheus

Grafana

Kafka

NATS

Tools

Kubernetes

ArgoCD

Prometheus

Grafana

Kafka

NATS

Job description

Together AI is building a new era of autonomous AI infrastructure. This role focuses on production backend systems for AI agents that diagnose failures, investigate incidents, and automate remediation at scale across our large GPU fleet.

You'll own core platform components—knowledge graphs, retrieval, orchestration, and tooling—enabling agents to reason, act, and continuously improve within a distributed ecosystem. This is a hands-on, impact-driven opportunity.