Senior AI Compute Engineer – Global GPU Cloud

FDE Times; Amsterdam; On-site; EUR 110,000 - 170,000; Full time

Job summary

Together AI is building the AI Native Cloud. We seek a Senior Software Engineer to own major components of a global AI cloud platform, including GPU virtualization, in‑DC IaaS, and scalable scheduling.

You will design, implement, and ship features across data centers, with a strong emphasis on reliability and performance. You will work on end‑to‑end ownership, write design docs, review code, and mentor engineers while collaborating with PMs and other teams to advance the Together AI stack in

Qualifications

• 5+ years of professional software development experience.
• Proficient in at least one backend language (Golang preferred).
• Experience delivering large-scale, end-to-end projects.
• Experience with microservices across cloud providers (AWS/Azure/GCP).
• Strong systems knowledge: compute, networking, storage, concurrency.
• Excellent communication, capable of writing design docs.
• Experience with infrastructure automation, observability, and CI/CD.

Responsibilities

• Build GPU and network virtualization stack for high performance and isolation.
• Maintain in-DC IaaS layer: compute, storage, networks, VMs, and fabrics.
• Scale the scheduling and management plane for on-demand and reserved clusters.
• Harden monitoring and automated remediation for fault tolerance.
• Own components end-to-end: design docs, milestones, production readiness.
• Mentor junior engineers and contribute to core Together AI platform.

Skills

Golang

Large-scale ownership

Distributed microservices

Cloud platforms

Systems knowledge

Communication skills

CI/CD tooling

Tools

Terraform

Ansible

Prometheus

Grafana

GitHub Actions

ArgoCD

Kubernetes

QEMU/KVM

Job description

Together AI is building the AI Native Cloud. We seek a Senior Software Engineer to own major components of a global AI cloud platform, including GPU virtualization, in‑DC IaaS, and scalable scheduling.

You will design, implement, and ship features across data centers, with a strong emphasis on reliability and performance. You will work on end‑to‑end ownership, write design docs, review code, and mentor engineers while collaborating with PMs and other teams to advance the Together AI stack in