AI Infrastructure Systems Engineer — Hybrid (Amsterdam/UK)

Togetherai; Amsterdam; Hybrid; EUR 120,000 - 180,000; Full time

Job summary

Together AI, the AI Native Cloud, is building and operating one of the world’s largest GPU fleets for frontier model training and inference.

This role focuses on designing fleet automation systems, AI infrastructure agents, and platforms to monitor hardware health and optimize GPU availability across thousands of accelerators. The team embraces hybrid work in Amsterdam and remote roles in the UK.

Qualifications

• 3+ years building distributed systems or large-scale backend software.
• Strong software engineering skills in Python, Go, or Rust.
• Experience building platforms, automation systems, or developer infrastructure.
• Experience with Linux, Kubernetes, Terraform, Ansible, or similar infra tech.
• Strong systems thinking with ability to understand problems across hardware and software.
• Automation-first mindset to eliminate repetitive tasks.

Responsibilities

• Design and build fleet automation systems for GPU clusters with minimal human intervention.
• Build AI Infrastructure Agents for deployment, failure root-cause, and autonomous remediation.
• Develop Fleet Intelligence platforms monitoring hardware health, firmware, networking, and workload performance.
• Build software to maximize GPU availability, utilization, performance and reliability.
• Create automated validation systems for GPUs and high-speed fabrics and storage.
• Develop internal platforms and developer tools to manage infrastructure via software.
• Improve deployment velocity, reliability, and operational efficiency through automation.
• Partner with hardware, networking, platform, and AI teams to push AI infra limits.

Skills

Distributed systems

Python

Go

Rust

Automation

Linux

Kubernetes

Tools

Kubernetes

Terraform

Ansible

Linux

Job description

Together AI, the AI Native Cloud, is building and operating one of the world’s largest GPU fleets for frontier model training and inference.

This role focuses on designing fleet automation systems, AI infrastructure agents, and platforms to monitor hardware health and optimize GPU availability across thousands of accelerators. The team embraces hybrid work in Amsterdam and remote roles in the UK.