Staff Platform Engineer: AI Inference Cluster Orchestrator

Together AI; London (KY); On-site; USD 150,000 - 230,000; Full time

Job summary

Together AI is seeking a Software Engineer to build infrastructure-as-software that provisions hardware and manages full lifecycle—from discovery to running AI clusters for training or inference. You will design manifest-driven state machines, build production-grade code with typing and CI/CD, and own the platform end-to-end, including on-call operations and reliability of the pipelines in production.

The role emphasizes a product mindset, delivering self-service APIs for the inference team and

Qualifications

• Experience delivering production-grade software for infrastructure.
• Experience with durable workflow orchestration to manage long-running jobs.
• Ability to design state machines for hardware provisioning.
• Experience building internal platforms or APIs for engineering teams.
• Strong typing, testing, and CI/CD mindset.

Responsibilities

• Build the provisioning state machine for hardware lifecycle.
• Create self-service API to provision, scale, tear down clusters.
• Automate self-healing and capacity reintroduction.
• Own reliability of the pipeline with idempotency and retries.
• Collaborate with ML platform team to encode cluster shapes.
• Develop software with strong typing, tests, and CI/CD for infrastructure code.

Skills

Go

Python

Rust

Temporal

Cadence

Kubernetes

APIs / service design

Production software

Tools

Kubernetes

CI/CD

Git

Job description

Together AI is seeking a Software Engineer to build infrastructure-as-software that provisions hardware and manages full lifecycle—from discovery to running AI clusters for training or inference. You will design manifest-driven state machines, build production-grade code with typing and CI/CD, and own the platform end-to-end, including on-call operations and reliability of the pipelines in production.

The role emphasizes a product mindset, delivering self-service APIs for the inference team and