Senior AI Agent Systems Engineer — Infra & Platform

Together; San Francisco (CA); On-site; USD 250,000 - 300,000; Full time

Benefits offered by this job

Remote work flexibility

Equity

Health insurance

Job summary

Together AI’s Infra Agent Systems group is looking for a Senior Software Engineer to build production AI agents that diagnose hardware issues and automate workflows across a massive GPU fleet. You’ll also help craft the core platform with knowledge graphs, retrieval, and orchestration tooling.

You will own end-to-end services, drive architecture decisions, and collaborate across teams to deliver reliable, scalable infrastructure while enabling self-improving AI capabilities at scale.

Qualifications

• 5+ years of experience building production backend systems and distributed infrastructures.
• Strong systems design with ownership of large-scale services.
• Depth in AI agent systems, knowledge graphs, or search technologies.
• Backend engineering with API design and data modeling.
• Experience with Kubernetes, ArgoCD, IaC, and cloud platforms.
• Proficiency in Go, TypeScript, Python, or Rust.
• Nice to have GPU infra, Kafka, Prometheus/Grafana.

Responsibilities

• Design and build production AI agent systems that diagnose, investigate, and remediate infrastructure issues across one of the world’s largest GPU fleets.
• Build the distributed services, orchestration framework, knowledge graph, and retrieval systems that power infrastructure agents.
• Develop fleet intelligence systems that combine telemetry, infrastructure state, operational knowledge, and historical incidents to help agents make better decisions.
• Integrate with observability, incident management, ticketing, fleet inventory, source control, chat, and internal infrastructure systems through well-designed APIs.
• Own services end to end, including architecture, implementation, testing, deployment, observability, and production operations.
• Improve agent performance through evaluations, retrieval improvements, better tools, and production feedback loops.
• Turn what agents learn in production into reliable, reviewed software and automation.

Skills

Distributed systems

API design

Kubernetes

Graph data modeling

Knowledge graphs

RAG / semantic search

Backend languages

Tools

ArgoCD

NATS

Kafka

Prometheus

Grafana

Job description

Together AI’s Infra Agent Systems group is looking for a Senior Software Engineer to build production AI agents that diagnose hardware issues and automate workflows across a massive GPU fleet. You’ll also help craft the core platform with knowledge graphs, retrieval, and orchestration tooling.

You will own end-to-end services, drive architecture decisions, and collaborate across teams to deliver reliable, scalable infrastructure while enabling self-improving AI capabilities at scale.