Senior AI Compute Engineer, Cloud GPU Scale — Amsterdam

Together Computer Inc; Amsterdam; On-site; EUR 120,000 - 180,000; Full time

Job summary

Together AI is building the AI Native Cloud, a high-performance platform for the full generative AI lifecycle. We are seeking a Senior Software Engineer focusing on AI Compute to own major components of the Together Cloud platform, enabling scalable GPU clusters and advanced virtualization across data centers.

You will design and implement end-to-end systems, collaborate across teams, and contribute to the core Together AI platform, with opportunities to work on cutting-edge hardware like

Qualifications

• 5+ years of professional software development experience.

Responsibilities

• Build the GPU and network virtualization stack for high-performance, isolated compute across heterogeneous hardware.
• Build and maintain the in-DC IaaS layer including VMs, storage, networks, and InfiniBand partitions.
• Scale the distributed GPU scheduling and global management plane for on-demand and reserved clusters.
• Harden the monitoring and automated remediation layer for fault tolerance and reliability.
• Own your components end-to-end from design to GA launch.
• Raise the bar through code reviews, design feedback, and mentoring junior engineers.
• Build tooling and docs that other teams rely on, contributing to core Together AI platform.

Skills

Ownership of large-scale projects

Excellent communication

Production-quality code

Cross-team collaboration

Strong debugging and troubleshooting

Tools

Golang

Kubernetes internals

VMs/Hypervisors (QEMU/KVM)

DC networking (VXLAN/VPC)

Terraform

Ansible

Prometheus/Grafana

GitHub Actions/ArgoCD

CUDA/NCCL

Job description

Together AI is building the AI Native Cloud, a high-performance platform for the full generative AI lifecycle. We are seeking a Senior Software Engineer focusing on AI Compute to own major components of the Together Cloud platform, enabling scalable GPU clusters and advanced virtualization across data centers.

You will design and implement end-to-end systems, collaborate across teams, and contribute to the core Together AI platform, with opportunities to work on cutting-edge hardware like