Staff AI Compute Platform Engineer - Global Cloud

Together Computer Inc; Amsterdam; On-site; EUR 150,000 - 190,000; Full time

Job summary

Together AI in Amsterdam seeks a Staff Software Engineer focusing on AI Compute to define and build major components of the Together Cloud platform. You’ll architect a highly available global cloud infrastructure with virtualization of cutting-edge ML hardware and data-center-scale services.

You will own the in-DC IaaS layer, GPU scheduling, and the global management plane, leading design reviews and mentoring engineers while shaping standards across teams.

Qualifications

• 7+ years of professional software development experience with expert-level backend knowledge (Golang preferred).
• Track record of owning the architecture of large distributed systems at scale.
• Deep experience building and operating globally distributed microservices across AWS/Azure/GCP.
• Expert systems knowledge in compute, networking, and storage with scalable design.
• Demonstrated technical leadership, mentoring engineers and leading design reviews.
• Excellent communication and diplomacy, able to align technical and non-technical stakeholders.
• Experience maintaining reliable production systems with infrastructure automation and observability.

Responsibilities

• Own the GPU and network virtualization stack—hypervisor, kernel, and SDN for high performance and isolation.
• Own the in-DC IaaS layer—architect and roadmap services, Kubernetes operators, and libraries for data center provisioning.
• Design the GPU scheduling and global management plane for on-demand and reserved clusters across data centers.
• Architect monitoring and automated remediation for fault tolerance of distributed workloads.
• Set technical direction across teams and define standards, reviews, and tooling.
• Grow the team by mentoring engineers and raising the hiring bar.
• Set engineering bar with testing frameworks, docs, and open-source contributions.

Skills

Golang

Distributed systems

Cloud infra

Technical leadership

Communication

Performance tuning

Tools

Terraform

Ansible

Prometheus

Grafana

GitHub Actions

ArgoCD

Job description

Together AI in Amsterdam seeks a Staff Software Engineer focusing on AI Compute to define and build major components of the Together Cloud platform. You’ll architect a highly available global cloud infrastructure with virtualization of cutting-edge ML hardware and data-center-scale services.

You will own the in-DC IaaS layer, GPU scheduling, and the global management plane, leading design reviews and mentoring engineers while shaping standards across teams.