AI Infrastructure Engineer — Automate GPU Fleets (Hybrid)

WeHireYou; New Amsterdam (IN); Hybrid; USD 113,000 - 181,000; Full time

Job summary

Together AI is hiring an AI Infrastructure Systems Engineer to design and operate the GPU fleets powering frontier AI models. Hybrid work in Amsterdam or remote UK, focusing on automation and software-defined infrastructure.

You’ll build fleet automation, AI agents, and fleet intelligence platforms, collaborating with hardware, networking, and AI teams to push AI infrastructure limits at scale.

Qualifications

• 3+ years building distributed systems, infrastructure platforms, or large-scale backend software.
• Strong software engineering skills in Python, Go, or Rust.
• Experience building automation systems and developer infrastructure.
• Experience with Linux, Kubernetes, Terraform, Ansible, or similar infra tech.

Responsibilities

• Design and build fleet automation systems that provision, validate, deploy, upgrade, repair, and retire GPU clusters with minimal human intervention.
• Build AI Infrastructure Agents that automate deployment, root-cause failures, incident triage, and autonomous remediation.
• Develop Fleet Intelligence platforms monitoring hardware health, firmware, networking, storage, thermals, and workload performance.
• Build software to maximize GPU availability, utilization, performance, and reliability across thousands of accelerators.
• Create automated validation systems for GPUs, InfiniBand/RoCE fabrics, NVLink/NVSwitch, storage, and distributed AI workloads.

Skills

Python

Go

Rust

Distributed systems

Automation

Linux

Kubernetes

Terraform

Ansible

Tools

Linux

Kubernetes

Terraform

Ansible

Job description

Together AI is hiring an AI Infrastructure Systems Engineer to design and operate the GPU fleets powering frontier AI models. Hybrid work in Amsterdam or remote UK, focusing on automation and software-defined infrastructure.

You’ll build fleet automation, AI agents, and fleet intelligence platforms, collaborating with hardware, networking, and AI teams to push AI infrastructure limits at scale.