Staff AI Compute Cloud Architect

Fdetimes; Amsterdam; Hybrid; EUR 180,000 - 240,000; Full time

Job summary

Together AI, the AI Native Cloud, is seeking a Staff Software Engineer focusing on AI Compute to set technical direction and build major components of our next-gen cloud platform. You will own GPU virtualization, in-DC IaaS, and the global management plane across data centers and thousands of GPUs.

You'll lead design reviews, mentor engineers, and raise the bar for reliability, performance, and scale, shaping the core open-source Together AI platform while collaborating with multi-disciplinary

Qualifications

• 7+ years of professional software development experience with expert-level proficiency in at least one backend language (Golang) and producing high-performance, production-quality code.
• Experience owning architecture of large distributed systems and building production-scale cloud infrastructure.
• Deep experience with globally distributed microservices across cloud providers (AWS, Azure, GCP).
• Strong systems knowledge across compute, networking, storage, memory management, and I/O at scale.
• Demonstrated technical leadership: mentoring, design reviews, cross-team alignment.
• Excellent communication and diplomacy to write design docs and work with stakeholders.
• Experience with infrastructure automation (Terraform, Ansible), observability (Prometheus, Grafana), and CI/CD (GitHub Actions, ArgoCD).

Responsibilities

• Own the GPU and network virtualization stack: hypervisor, kernel, and SDN for high-performance, portable, isolated compute.
• Own the in-DC IaaS layer: design services, operators, and libraries provisioning compute, storage, and networks in data centers.
• Design GPU scheduling and the global management plane for on-demand and reserved clusters across many data centers.
• Architect monitoring and automated remediation for fault tolerance in large-scale deployments.
• Set technical direction across teams and define standards for build and reliability.

Skills

Golang

Backend systems

Distributed systems

Leadership

Communication

Tools

Terraform

Ansible

Prometheus

Grafana

GitHub Actions

ArgoCD

Kubernetes

QEMU/KVM

Job description

Together AI, the AI Native Cloud, is seeking a Staff Software Engineer focusing on AI Compute to set technical direction and build major components of our next-gen cloud platform. You will own GPU virtualization, in-DC IaaS, and the global management plane across data centers and thousands of GPUs.

You'll lead design reviews, mentor engineers, and raise the bar for reliability, performance, and scale, shaping the core open-source Together AI platform while collaborating with multi-disciplinary