Platform Engineer: AI Inference Infrastructure

Together AI; Amsterdam; On-site; EUR 90,000 - 130,000; Full time

Job summary

Together AI is seeking a Software Engineer to build infrastructure-as-software that provisions hardware and manages full lifecycle of AI clusters. You’ll design manifest-driven state machines, interfaces, and workflows to bring racks of GPUs into service for training and inference.

This role emphasizes strong software engineering, testing, and CI/CD in production environments. You will work with a product-minded team building internal platforms and APIs used by other engineers, owning the

Qualifications

• Strong software engineering background in Go, Python, Rust or similar — you write and test real software for a living.
• Experience with durable workflow orchestration tools such as Temporal, Cadence, or equivalent to run long-lived, manifest-driven workflows.

Responsibilities

• Build the provisioning state machine: model the full lifecycle of a physical host from discovery to decommission/RMA with explicit states.
• Build the self-service API: design declarative APIs and a control plane for one-click clustering.
• Automate self-healing: detect degraded nodes, trigger repair or replacement, and restore capacity automatically.
• Own reliability of the pipeline: ensure idempotency, retries, rollback, and drift detection.

Skills

Go

Python

Rust

Temporal

Cadence

Kubernetes controllers

Event-driven systems

Tools

Kafka

NATS

SQS

NCCL

CUDA

Job description

Together AI is seeking a Software Engineer to build infrastructure-as-software that provisions hardware and manages full lifecycle of AI clusters. You’ll design manifest-driven state machines, interfaces, and workflows to bring racks of GPUs into service for training and inference.

This role emphasizes strong software engineering, testing, and CI/CD in production environments. You will work with a product-minded team building internal platforms and APIs used by other engineers, owning the