Senior AI Compute Engineer - GPU Cloud Platform

Fdetimes; Amsterdam; Hybrid; EUR 120,000 - 180,000; Full time

Job summary

Together AI is building the AI Native Cloud, a scalable platform for the generative AI lifecycle, with a focus on high-performance GPU compute, virtualization, and global multi-datacenter deployment. The Senior Software Engineer will own major components across the cloud infra, drive end-to-end development, and contribute to open-source Together AI projects.

As part of the Together Cloud org, you will work on automated bootstrapping, virtualization, and fault-tolerant control planes,

Qualifications

• 5+ years of professional software development experience.
• Proficiency in at least one backend language (Golang preferred).
• Experience building and operating micro-service architectures across cloud providers (AWS, Azure, GCP).
• Strong systems knowledge across compute, networking, and storage, including concurrency and high-performance I/O.
• Excellent communication skills for design docs and cross-team collaboration.

Responsibilities

• Build the GPU and network virtualization stack for high performance and isolation.
• Develop and maintain in-DC IaaS layer, including VMs, storage, and networks.
• Scale the distributed GPU scheduling and global management plane.
• Harden monitoring and automated remediation for fault tolerance.
• Own components end-to-end from design to GA launch.
• Mentor junior engineers and contribute to code reviews.
• Develop tooling and docs to support other teams and open-source ecosystem.

Skills

Backend Golang

Distributed systems

Kubernetes

Cloud platforms

System design

Tools

Terraform

Ansible

Prometheus

Grafana

GitHub Actions

ArgoCD

Job description

Together AI is building the AI Native Cloud, a scalable platform for the generative AI lifecycle, with a focus on high-performance GPU compute, virtualization, and global multi-datacenter deployment. The Senior Software Engineer will own major components across the cloud infra, drive end-to-end development, and contribute to open-source Together AI projects.

As part of the Together Cloud org, you will work on automated bootstrapping, virtualization, and fault-tolerant control planes,