Senior Backend Engineer: AI GPU Orchestration & Scheduling

MetAntz; Palo Alto (CA); Hybrid; USD 150,000 - 190,000; Full time

Benefits offered by this job

Hybrid work model

Equity

Competitive salary

Job summary

Zettabyte is looking for a Backend Engineer to build systems that orchestrate GPU clusters for AI workloads. You will design APIs to abstract complex GPU operations, develop scheduling to maximize utilization, and manage GPU lifecycles from provisioning to release.

You will work across GPU resource tracking, billing, monitoring, and multi-tenancy while collaborating with frontend teams. This hybrid role requires strong backend expertise and a startup mindset.

Qualifications

• 5+ years backend engineering with distributed systems experience.
• Strong proficiency in Go and Python or similar languages.
• Experience designing APIs (REST, GraphQL, gRPC) and building scalable services.

Responsibilities

• Design APIs that abstract GPU operations into simple developer experiences.
• Build scheduling algorithms to maximize GPU utilization while meeting SLA.
• Develop resource management for GPU lifecycle: provisioning, allocation, scheduling, release.
• Create usage tracking and billing systems for GPU-hours and memory usage.
• Implement monitoring for GPU metrics, health checks, and failure recovery.
• Build multi-tenancy with resource isolation and fair scheduling.
• Collaborate with frontend engineers to expose infrastructure through intuitive interfaces.
• Leverage AI-assisted coding tools to boost productivity and code quality.

Skills

Go

Python

Distributed systems

APIs (REST/GraphQL/gRPC)

Linux

Tools

Docker

Kubernetes

Git

Job description

Zettabyte is looking for a Backend Engineer to build systems that orchestrate GPU clusters for AI workloads. You will design APIs to abstract complex GPU operations, develop scheduling to maximize utilization, and manage GPU lifecycles from provisioning to release.

You will work across GPU resource tracking, billing, monitoring, and multi-tenancy while collaborating with frontend teams. This hybrid role requires strong backend expertise and a startup mindset.