Staff Software Engineer - Kubernetes Platform (GPU)

Together AI; Amsterdam; On-site; EUR 110,000 - 150,000; Full time

Job summary

Together AI, the AI Native Cloud, seeks a software engineer to build a Kubernetes-native control plane that provisions and runs our GPU inference fleet. You will design a manifest-driven API for clusters, models, and capacity changes, with controllers handling lifecycle and operator concerns.

You will optimize fragmentation and scheduling, and ship self-service surfaces with robust health and remediation systems.

Qualifications

• Strong software engineering background in Go, Python, Rust or similar and you write and test real software.
• Experience with durable workflow orchestration tools such as Temporal, Cadence, or equivalent.
• Experience building software control planes or orchestration systems that model state and reconcile it over time.
• Experience with event-driven systems using message queues, streams, or pub/sub.
• A product mindset and experience building internal platforms or APIs for other teams.

Responsibilities

• Build the provisioning state machine modeling full lifecycle of a host and GPU stack.
• Design declarative self-service APIs and a control plane for one-click cluster requests.
• Automate self-healing: detect, drain, repair or replace, reintroduce capacity.
• Ensure pipeline reliability with idempotency, retries, rollback, and drift detection.
• Collaborate with ML platform teams to encode cluster shapes as abstractions in the platform.
• Engineer with strong typing, automated tests, code reviews, versioning, and CI/CD.

Skills

Go

Python

Rust

Kubernetes

Event-driven design

Tools

Temporal

Cadence

Kafka

NATS

SQS

CI/CD

Job description

Together AI, the AI Native Cloud, seeks a software engineer to build a Kubernetes-native control plane that provisions and runs our GPU inference fleet. You will design a manifest-driven API for clusters, models, and capacity changes, with controllers handling lifecycle and operator concerns.

You will optimize fragmentation and scheduling, and ship self-service surfaces with robust health and remediation systems.