Senior AI Compute Infrastructure Platform Engineer

Fdetimes; Amsterdam; Hybrid; EUR 90,000 - 130,000; Full time

Job summary

Together AI is seeking a Software Engineer to build infrastructure-as-software that provisions hardware, stands up GPU clusters, and manages lifecycle through manifest-driven state machines. You will ship typed, tested production code and own operation in production to eliminate manual provisioning.

Collaborating with the inference/ML platform team, you’ll design a robust control plane and self-service APIs for one-click cluster lifecycle management, with strong emphasis on reliability and

Qualifications

• Strong software engineering background in Go, Python, Rust, or similar - you write and test real software for a living.
• Experience with durable workflow orchestration tools such as Temporal or Cadence.
• Experience building software control planes or orchestration systems that model state and reconcile it over time.
• Experience with event-driven systems - designing and building software around message queues, event streams, or pub/sub.
• A product mindset. You've built internal platforms or APIs consumed by other engineering teams and care about the developer experience of what you ship.
• Nice to have: Exposure to bare-metal provisioning and networking fundamentals; GPU infrastructure.

Responsibilities

• Build the provisioning state machine: design and implement the software that models the full lifecycle of a physical host from discovery, inference bring-up to GPU driver/CUDA stack, health validation, and decommission/RMA as explicit, versioned states and transitions.
• Build the self-service API: design declarative APIs and a control plane so the inference team can request, scale, and tear down inference clusters with one API call - no ticket, no human in the loop.
• Automate self-healing: detect degraded or failed nodes, drain them safely, trigger repair or replacement, and reintroduce healthy capacity into the pool automatically.
• Own reliability of the pipeline: idempotency, retries, rollback, and drift detection so the provisioning system is as dependable as any other production service.
• Partner with the inference/ML platform team: understand the cluster shapes they need - topology, interconnect, scheduling constraints - and encode them as first-class abstractions in the platform.
• Engineer it like software: strong typing, automated tests, code review, versioning, and CI/CD for infrastructure code this is a product, not a collection of Ansible playbooks.

Skills

Go

Python

Rust

Event-driven design

APIs

Product mindset

Tools

Temporal

Cadence

Kubernetes

Pub/Sub

Job description

Together AI is seeking a Software Engineer to build infrastructure-as-software that provisions hardware, stands up GPU clusters, and manages lifecycle through manifest-driven state machines. You will ship typed, tested production code and own operation in production to eliminate manual provisioning.

Collaborating with the inference/ML platform team, you’ll design a robust control plane and self-service APIs for one-click cluster lifecycle management, with strong emphasis on reliability and