Autonomous AI Infrastructure Engineer: GPU Fleet Mastery

Together; San Francisco (CA); On-site; USD 190,000 - 270,000; Full time

Benefits offered by this job

Health insurance

Startup equity

Competitive benefits

Job summary

Together AI is building and operating one of the world’s largest GPU fleets for frontier model training and inference in San Francisco. We seek engineers who treat infrastructure as software and automate everything to scale massively.

Responsibilities include designing fleet automation systems, AI Infrastructure Agents, and Fleet Intelligence to monitor, diagnose, and optimize performance. This role demands a strong automation mindset and collaboration across teams.

Qualifications

• 3+ years building distributed systems, infrastructure platforms, or large-scale backend software.
• Strong software engineering skills in Python, Go, or Rust.
• Experience building platforms, automation systems, or developer infrastructure.
• Experience with Linux, Kubernetes, Terraform, Ansible, or similar infrastructure technologies.
• Strong systems thinking with the ability to understand problems across hardware and software.
• A passion for solving complex infrastructure challenges through software.
• An automation-first mindset—if a task is repeated, your instinct is to build a system to eliminate it.

Responsibilities

• Design and build fleet automation systems that provision, validate, deploy, upgrade, repair, and retire GPU clusters with minimal human intervention.
• Build AI Infrastructure Agents that automate deployment, root-cause failures, incident triage, and autonomous remediation.
• Develop Fleet Intelligence platforms that monitor hardware health, firmware, networking, storage, thermals, and workload performance to predict failures.
• Build software that maximizes GPU availability, utilization, performance, and reliability across thousands of accelerators.
• Create automated validation systems for GPUs, InfiniBand/RoCE fabrics, NVLink/NVSwitch, storage, and distributed AI workloads.
• Build internal platforms and developer tools to manage infrastructure through software, not manual operations.
• Continuously improve deployment velocity, reliability, and operational efficiency through automation.
• Partner with hardware, networking, platform, and AI teams to push AI infrastructure limits.

Skills

Python

Go

Rust

Distributed systems

Tools

Kubernetes

Terraform

Ansible

Linux

Job description

Together AI is building and operating one of the world’s largest GPU fleets for frontier model training and inference in San Francisco. We seek engineers who treat infrastructure as software and automate everything to scale massively.

Responsibilities include designing fleet automation systems, AI Infrastructure Agents, and Fleet Intelligence to monitor, diagnose, and optimize performance. This role demands a strong automation mindset and collaboration across teams.