Staff AI Compute Cloud Engineer — Remote & Scalable GPU Infra

Togetherai; San Francisco (CA); Remote; USD 260,000 - 300,000; Full time

Benefits offered by this job

Equity

Health insurance

Remote flexibility

Job summary

Together AI seeks a Staff Software Engineer focused on AI Compute to shape the Together Cloud platform. You’ll architect high-performance GPU virtualization, in-DC IaaS, and the global management plane across data centers and cloud providers.

You will mentor engineers, drive cross-team alignment, and define standards for reliability, scalability, and tooling, with remote-friendly arrangement.

Qualifications

• 7+ years of professional software development and system design experience.
• Expertise in large distributed systems and backend development.
• Experience with multi-cloud environments (AWS, Azure, GCP).
• Strong knowledge of virtualization, networking, and storage at scale.
• Proven technical leadership, mentoring, and cross-team collaboration.
• Excellent communication and diplomacy with technical and non-technical stakeholders.
• Experience with Terraform, Ansible, Prometheus, Grafana, CI/CD pipelines.

Responsibilities

• Own GPU and network virtualization stack across hardware and software layers.
• Architect in-DC IaaS layer and roadmap services, Kubernetes operators, and libraries.
• Design GPU scheduling and a global management plane for on-demand clusters.
• Architect monitoring and automated remediation for fault tolerance.
• Set engineering standards, reviews, and developer tooling.
• Grow the team and raise the hiring bar for Together Cloud.
• Collaborate with cross-functional teams to deliver scalable infrastructure.

Skills

Backend development

Distributed systems

Cloud providers

Infrastructure automation

Observability tools

Leadership

Communication

CI/CD

Tools

Terraform

Ansible

Prometheus

Grafana

GitHub Actions

ArgoCD

Kubernetes

Job description

Together AI seeks a Staff Software Engineer focused on AI Compute to shape the Together Cloud platform. You’ll architect high-performance GPU virtualization, in-DC IaaS, and the global management plane across data centers and cloud providers.

You will mentor engineers, drive cross-team alignment, and define standards for reliability, scalability, and tooling, with remote-friendly arrangement.