Senior AI Compute Engineer - Remote GPU Cloud

Fdetimes; San Francisco (CA); Hybrid; USD 220,000 - 270,000; Full time

Job summary

Together AI is building the AI Native Cloud, an end-to-end platform for the full generative AI lifecycle. As a Senior Software Engineer focusing on AI Compute in the Together Cloud org, you will own major components of the next generation AI cloud platform—a highly available, global cloud infrastructure with advanced virtualization of GPUs, DPUs, and high-performance networks.

You will work on end-to-end ownership from scoping with PMs to GA launch, building and maintaining services that power

Qualifications

• 5+ years of professional software development experience with backend language (Golang desired).
• Ownership of large-scale projects end-to-end with high-performance production code.
• Experience building and operating micro-service architectures across one or more cloud providers (AWS, Azure, GCP).
• Strong systems knowledge across compute, networking, and storage, including concurrency, memory management, performant I/O, and scale.
• Excellent communication skills — able to write clear design docs and work effectively with both technical and non-technical team members.
• Experience building and operating reliable, customer-facing production systems at scale, and owning infrastructure automation (Terraform, Ansible), observability (Prometheus, Grafana), and CI/CD (GitHub Actions, ArgoCD).

Responsibilities

• Build the GPU and network virtualization stack for high-performance, portable isolation across heterogeneous hardware.
• Maintain in-DC IaaS layer: services, operators, and libraries provisioning compute/storage/networks in data centers.
• Scale the distributed GPU scheduling and global management plane for on-demand/reserved clusters.
• Harden monitoring and automated remediation for fault tolerance of distributed systems.
• Own components end-to-end: write design docs, milestones, and improve production reliability.
• Mentor junior engineers and contribute to code reviews and design discussions.
• Build tooling and documentation used by multiple teams and contribute to the core Together AI platform.

Skills

Golang

Distributed systems

Cloud platforms

CI/CD

Tools

Kubernetes

Terraform

Ansible

Prometheus

Grafana

GitHub Actions

ArgoCD

Job description

Together AI is building the AI Native Cloud, an end-to-end platform for the full generative AI lifecycle. As a Senior Software Engineer focusing on AI Compute in the Together Cloud org, you will own major components of the next generation AI cloud platform—a highly available, global cloud infrastructure with advanced virtualization of GPUs, DPUs, and high-performance networks.

You will work on end-to-end ownership from scoping with PMs to GA launch, building and maintaining services that power