Senior AI Infra Engineer: Self-Improving Agents (Remote)

Togetherai; San Francisco (CA); Hybrid; USD 250,000 - 300,000; Full time

Benefits offered by this job

Startup equity

Health insurance

Remote-friendly

Job summary

Together AI, the AI Native Cloud, is hiring for Infrastructure Agent Systems and Core Agent Platform roles. You will design production AI agent systems that diagnose and remediate infrastructure issues across a massive GPU fleet, and build the platform powering these agents, including knowledge graphs and retrieval systems.

We seek engineers with strong backend experience, systems design expertise, and comfort with Go, TypeScript, Python, or Rust.

Qualifications

• 5+ years of experience building production backend systems, distributed systems, or infrastructure platforms.
• Strong systems design skills and ownership of large systems from design to production.
• Experience with AI agent systems, knowledge graphs, or search/retrieval.
• Backend engineering with API design, data modeling, and cross-system integrations.
• Experience with Kubernetes, GitOps (ArgoCD), IaC, and cloud platforms.

Responsibilities

• Design and build production AI agent systems for diagnosing and remediating infrastructure issues.
• Develop distributed services, orchestration, knowledge graphs, and retrieval systems.
• Build fleet intelligence by combining telemetry, state, and incidents for better decisions.
• Integrate with observability, incident management, ticketing, and other systems via APIs.
• Own services end-to-end: architecture, implementation, testing, deployment, observability, operations.
• Improve agent performance via evaluations, retrieval improvements, and tooling.
• Turn learned insights into reliable software and automation.

Skills

Backend systems

Distributed systems

AI agent systems

Knowledge graphs

Search & retrieval

Go, TS, Python, Rust

Tools

Kubernetes

ArgoCD

CI/CD

NATS / Kafka

Prometheus / Grafana

Job description

Together AI, the AI Native Cloud, is hiring for Infrastructure Agent Systems and Core Agent Platform roles. You will design production AI agent systems that diagnose and remediate infrastructure issues across a massive GPU fleet, and build the platform powering these agents, including knowledge graphs and retrieval systems.

We seek engineers with strong backend experience, systems design expertise, and comfort with Go, TypeScript, Python, or Rust.