Senior AI Compute Engineer — Cloud GPU Platform

Together Computer Inc; San Francisco (CA); On-site; USD 220,000 - 270,000; Full time

Benefits offered by this job

Health insurance

Equity

Job summary

Together AI is building the AI Native Cloud, a high-performance platform for the generative AI lifecycle. As a Senior Software Engineer focusing on AI Compute, you will own major components of a global cloud infrastructure, virtualization of ML hardware, and scalable services powering inference, RL, and fine-tuning across many data centers.

You will design, implement, and operate critical systems, contribute to open-source Together AI platform, and mentor engineers while collaborating with teams

Qualifications

• 5+ years of professional software development experience with backend focus.
• Experience building and operating high-performance, globally distributed micro-service architectures across one or more cloud providers.

Responsibilities

• Build the GPU and network virtualization stack for high-performance, isolated compute across heterogeneous hardware.
• Build and maintain the in-DC IaaS layer: provision and manage compute, storage, and networks in data centers.
• Scale the distributed GPU scheduling and global management plane for on-demand and reserved clusters.
• Harden monitoring and automated remediation for fault-tolerant systems.
• Own components end-to-end: design docs, milestones, and production reliability enhancements.
• Mentor junior engineers and contribute to cross-team code reviews and designs.
• Develop tooling for teams: testing frameworks, dev tools, and core platform contributions.

Skills

Golang

Distributed systems

Kubernetes

Cloud infrastructure

Tools

Terraform

Ansible

Prometheus

Grafana

GitHub Actions

ArgoCD

Job description

Together AI is building the AI Native Cloud, a high-performance platform for the generative AI lifecycle. As a Senior Software Engineer focusing on AI Compute, you will own major components of a global cloud infrastructure, virtualization of ML hardware, and scalable services powering inference, RL, and fine-tuning across many data centers.

You will design, implement, and operate critical systems, contribute to open-source Together AI platform, and mentor engineers while collaborating with teams