Global GPU Infra & Inference Network Lead

PolarGrid

Ottawa

On-site

CAD 120,000 - 180,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

PolarGrid, an early-stage Canadian company delivering managed AI inference, is seeking a GPU Infrastructure Engineer to scale its distributed GPU fleet across sites. You will own provisioning, burn-in, validation, and staged production rollout for new sites, ensuring smooth traffic shifts and latency control.

You will run the global routing layer, tune performance using live signals like latency and capacity, and build observability, automation, and reliability practices to keep services

Qualifications

  • Experience operating distributed systems across multiple sites or regions with high availability targets.
  • Strong networking fundamentals: BGP, DNS, TCP/TLS and load balancing.
  • Hands-on experience running bare-metal GPU fleets: provisioning, burn-in, firmware and node lifecycle.
  • InfiniBand or RDMA networking experience.
  • Experience running LLM inference engines such as vLLM, SGLang or TensorRT-LLM, including multi-node serving, cold starts and TTFT.
  • Deep observability skills focused on p95/p99 latency and gray failures, not just uptime.
  • Experience designing failover, graceful degradation and automated recovery.
  • Strong automation and infrastructure-as-code mindset, including CI/CD for infrastructure.
  • Ability to plan capacity on constrained, uneven hardware supply.
  • Experience building internal tooling or control planes, ideally in Go or Rust.

Responsibilities

  • Scale PolarGrid's inference network to a geographically distributed fleet of GPU clusters.
  • Own provisioning, burn-in, validation and rollout of new sites.
  • Define site readiness for traffic and ensure low latency.
  • Manage global routing layer for best location routing based on latency, capacity and health.
  • Build observability with end-to-end tracing, latency alerting, and safe staged rollouts.
  • Develop automation and infrastructure-as-code for reliability and recovery.
  • Plan capacity with constrained hardware supply.
  • Operate multi-site, high-availability distributed systems.

Skills

Distributed systems
Networking
Observability
Automation
Infra as code
Go
Rust

Tools

CI/CD for infrastructure
Terraform

Job description

PolarGrid, an early-stage Canadian company delivering managed AI inference, is seeking a GPU Infrastructure Engineer to scale its distributed GPU fleet across sites. You will own provisioning, burn-in, validation, and staged production rollout for new sites, ensuring smooth traffic shifts and latency control.

You will run the global routing layer, tune performance using live signals like latency and capacity, and build observability, automation, and reliability practices to keep services

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

GPU Infrastructure Engineer
GPU Infrastructure Engineer

PolarGrid • Ottawa

On-site
CAD 120,000 - 180,000
Senior AI Infra Engineer — GPU, Kubernetes, RDMA (Equity)
Senior AI Infra Engineer — GPU, Kubernetes, RDMA (Equity)

NVIDIA Corporation • Canada

Remote
CAD 130,000 - 190,000
Equity
Benefits
Remote Solutions Architect - GPU-Driven Edge & AI Platforms
Remote Solutions Architect - GPU-Driven Edge & AI Platforms

PolarGrid • Toronto

Remote
CAD 90,000 - 150,000
Senior Software Engineer, DGX Cloud — Remote AI Infra
Senior Software Engineer, DGX Cloud — Remote AI Infra

NVIDIA Corporation • Toronto

Remote
CAD 140,000 - 190,000
Equity
Benefits
Senior Software Engineer - DGX Cloud
Senior Software Engineer - DGX Cloud

NVIDIA Corporation • Canada

On-site
CAD 135,000 - 220,000
Equity
Benefits
Staff Product Engineer
Staff Product Engineer

PolarGrid • Ottawa

On-site
CAD 120,000 - 150,000
Staff GPU Inference Engineer - High-Performance AI
Staff GPU Inference Engineer - High-Performance AI

FDE Times • Toronto

On-site
CAD 251,000 - 335,000
Senior Cluster SRE: GPU Racks, InfiniBand & On‑Site
Senior Cluster SRE: GPU Racks, InfiniBand & On‑Site

iFrame • Toronto, Montreal , Vancouver

On-site
CAD 299,000 - 484,000
Senior Software Engineer - DGX Cloud
Senior Software Engineer - DGX Cloud

CA01 NVIDIA Canada Dev. Inc. • Canada

Remote
CAD 130,000 - 190,000
Equity
Benefits
Senior Software Engineer - DGX Cloud
Senior Software Engineer - DGX Cloud

SheTO • Toronto

Remote
CAD 140,000 - 190,000
Equity
Benefits