Senior AI Cloud Infra Engineer - Remote & Equity

Remote; San Francisco (CA); Hybrid; USD 160,000 - 230,000; Full time

Benefits offered by this job

Health insurance

Startup equity

Remote-friendly

Job summary

Together AI is building the AI Acceleration Cloud, a scalable platform for the full generative AI lifecycle. You will design, build, and operate high-performance backend services and a global data-center fabric that virtualizes cutting-edge hardware.

The role emphasizes strong software engineering, Kubernetes mastery, and deep system knowledge, with remote-friendly options and competitive compensation including equity.

Qualifications

• 5+ years of professional software development experience in backend systems.
• Proficiency in at least one backend language (Golang preferred).
• Experience building and operating high-performance, globally distributed microservices across cloud providers (AWS/Azure/GCP).
• Excellent communication skills; ability to write design docs for technical and non-technical teams.
• Deep Kubernetes internals experience (operators, plugins, schedulers, patches).
• Deep VM/hypervisor experience (QEMU/KVM, cloud-hypervisor, VFIO, virtio, Kubevirt).
• Deep DC networking knowledge (VLAN, VXLAN, VPN, VPC, OVS/OVN).
• Terraform/Ansible, Prometheus/Grafana, CI/CD (GitHub Actions, ArgoCD) familiarity.
• GPU virtualization, DPUs/SmartNICs knowledge a plus; NCCL/CUDA knowledge a plus.

Responsibilities

• Perform architecture and research work for decentralized AI workloads.
• Contribute to core Together AI platform and services.
• Create tools, documentation, and testing frameworks.
• Support robust fault-tolerance and high-availability operations.

Skills

Golang

Kubernetes

Distributed systems

Networking (DC)

Terraform

Prometheus/Grafana

CI/CD (GitHub Actions)

GPU virtualization

QEMU/KVM

KubeVirt

Infiniband/DPUs

NCCL/CUDA

Tools

QEMU/KVM

KubeVirt

VFIO

Terraform

Ansible

Job description

Together AI is building the AI Acceleration Cloud, a scalable platform for the full generative AI lifecycle. You will design, build, and operate high-performance backend services and a global data-center fabric that virtualizes cutting-edge hardware.

The role emphasizes strong software engineering, Kubernetes mastery, and deep system knowledge, with remote-friendly options and competitive compensation including equity.