Senior AI Agent Infra Engineer – Production Systems

Together AI; Amsterdam; Hybrid; EUR 95,000 - 150,000; Full time

Job summary

Together AI, the AI Native Cloud, is building AI agents and the platform that powers them for large-scale infrastructure. This role focuses on production backend systems, distributed architectures, and end-to-end ownership from design through production.

You’ll design and operate infrastructure agents, knowledge graphs, and retrieval systems at scale, partnering with our data centers and platform teams to deliver reliable, high-performance software.

Qualifications

• 5+ years building production backend systems.
• Strong systems design and ownership from design to production.
• Experience with Kubernetes, GitOps, IaC, and cloud platforms.
• Comfortable with Go, TypeScript, Python, or Rust.

Responsibilities

• Design and build production AI agent systems that diagnose, investigate, and remediate infrastructure issues across one of the world’s largest GPU fleets.
• Build the distributed services, orchestration framework, knowledge graph, and retrieval systems that power infrastructure agents.
• Develop fleet intelligence systems that combine telemetry, infrastructure state, operational knowledge, and historical incidents to help agents make better decisions.
• Integrate with observability, incident management, ticketing, fleet inventory, source control, chat, and internal infrastructure systems through well-designed APIs.
• Own services end to end, including architecture, implementation, testing, deployment, observability, and production operations.
• Improve agent performance through evaluations, retrieval improvements, better tools, and production feedback loops.
• Turn what agents learn in production into reliable, reviewed software and automation.

Skills

Backend systems

Distributed systems

System design

API design

Kubernetes

GitOps

IaC

Graph databases

Search / retrieval

Prometheus

Grafana

Go

TypeScript

Python

Rust

Tools

Kubernetes

ArgoCD

NATS

Kafka

Prometheus

Grafana

Job description

Together AI, the AI Native Cloud, is building AI agents and the platform that powers them for large-scale infrastructure. This role focuses on production backend systems, distributed architectures, and end-to-end ownership from design through production.

You’ll design and operate infrastructure agents, knowledge graphs, and retrieval systems at scale, partnering with our data centers and platform teams to deliver reliable, high-performance software.