Senior AI Compute Engineer, Cloud GPU Platform

Together Computer Inc; Amsterdam; On-site; EUR 120,000 - 180,000; Full time

Job summary

Together AI is hiring a Senior Software Engineer focusing on AI Compute in the Together Cloud. You will build core components of a global AI cloud infrastructure, enabling high-performance GPU clusters, virtualization, and scalable management across data centers.

You will own end-to-end projects, from design docs to GA launch, and mentor junior engineers. You will work with Kubernetes operators, SDN libraries, and cloud-native tools to deliver robust, scalable services for inference, RL, and

Qualifications

• 5+ years of professional software development experience.
• Proficient in at least one backend language (Golang preferred).
• Experience with large-scale, distributed microservice architectures across cloud providers (AWS/Azure/GCP).
• Strong systems knowledge across compute, networking, storage, and performance.
• Experience with infrastructure automation and observability tools (Terraform, Ansible, Prometheus, Grafana).
• Ability to write design docs and collaborate across teams.

Responsibilities

• Build GPU and network virtualization stack for high performance and isolation.
• Develop and maintain in-DC IaaS layer including VMs, storage, and networks.
• Scale distributed GPU scheduling and management plane for on-demand and reserved clusters.
• Harden monitoring and automated remediation for fault tolerance.
• Own components end-to-end from design to GA launch.
• Mentor junior engineers and contribute to core platform tooling.

Skills

Golang

Cloud architectures

CI/CD

Terraform

Ansible

Prometheus

Grafana

GitHub Actions

ArgoCD

Kubernetes internals

Tools

Kubernetes

QEMU/KVM

VFIO

DCI/GPU virtualization

Job description

Together AI is hiring a Senior Software Engineer focusing on AI Compute in the Together Cloud. You will build core components of a global AI cloud infrastructure, enabling high-performance GPU clusters, virtualization, and scalable management across data centers.

You will own end-to-end projects, from design docs to GA launch, and mentor junior engineers. You will work with Kubernetes operators, SDN libraries, and cloud-native tools to deliver robust, scalable services for inference, RL, and