Remote Staff AI Compute Cloud Engineer

Fdetimes; San Francisco (CA); Remote; USD 260,000 - 300,000; Full time

Benefits offered by this job

Remote work flexibility

Job summary

Together AI is hiring a Staff Software Engineer focusing on AI Compute to set technical direction and build major components of the next‑gen AI cloud platform. You will lead virtualization of GPU compute and DC networking, design global management planes, and drive reliability at scale across data centers with high availability.

This role combines architecture, coding, and team leadership. You will mentor engineers, own critical components, and collaborate with teams across the company to

Qualifications

• 7+ years of professional software development experience with backend focus (Golang preferred).
• Own architecture of large distributed systems from blank page to production at scale.
• Deep experience with globally distributed microservice architectures across cloud providers (AWS/Azure/GCP).
• Expertise in compute, networking, and storage with scalable design and performance focus.
• Demonstrated technical leadership beyond code: mentoring, design reviews, cross-team alignment.
• Excellent written and verbal communication with stakeholders.
• Experience building and operating reliable production systems with Terraform/Ansible, Prometheus, Grafana, and CI/CD like GitHub Actions/ArgoCD.

Responsibilities

• Own GPU compute and network virtualization stack, ensuring high performance, isolation, and portability.
• Architect and roadmap in-DC IaaS layer, provisioning compute, storage, and networks across data centers.
• Design GPU scheduling and global management plane for on-demand and reserved clusters.
• Architect monitoring and automated remediation for fault tolerance across large-scale systems.
• Set technical direction, lead design reviews, and raise the hiring bar for the team.
• Grow the team and develop expertise in virtualization, DC networking, and GPU infrastructure.

Skills

Golang

Distributed systems

Technical leadership

Communication

Tools

Terraform

Ansible

Prometheus

Grafana

GitHub Actions

ArgoCD

Job description

Together AI is hiring a Staff Software Engineer focusing on AI Compute to set technical direction and build major components of the next‑gen AI cloud platform. You will lead virtualization of GPU compute and DC networking, design global management planes, and drive reliability at scale across data centers with high availability.

This role combines architecture, coding, and team leadership. You will mentor engineers, own critical components, and collaborate with teams across the company to