AI Infrastructure Engineer — GPU Clusters & HPC

Veeda AI; Toronto; On-site; CAD 120,000 - 170,000; Full time

Job summary

Veeda AI in Toronto, Ontario seeks a Member of Technical Staff to advance AI infrastructure for multimodal foundation world models. You will own GPU cluster operations, security, data transmission, and end-to-end production observability.

The role emphasizes hands-on HPC expertise, kernel and networking tuning, IaC automation, and collaboration with model and data teams to scale compute and data resources.

Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, or equivalent hands-on experience in HPC or infrastructure engineering.
• Strong troubleshooting skills below the framework layer: low-level Linux networking, kernel and PCIe/NUMA tuning, hardware diagnostics, and network or distributed storage (NFS, NVMe-oF, Lustre, Ceph).
• Proficient in automation and infrastructure-as-code tools (e.g., Ansible, Terraform, Helm, Python/Bash scripting).
• Experience supporting distributed deep learning workloads (PyTorch/NCCL, Ray, DeepSpeed) closely enough to tell an infrastructure fault from a model bug.

Responsibilities

• Design, deploy, and operate Slurm-on-Kubernetes GPU clusters.
• Own the compute, interconnect, storage, and scheduler resources for GPU clusters.
• Design, deploy, and operate identity provisioning and access control for sources, clusters, data storages, and dev tools.
• Design and maintain distributed data transmission and caching services for timely data delivery to clusters.
• Build telemetry pipelines (Prometheus, Grafana, DCGM, BMC/Redfish) to catch errors and diagnose issues.
• Lead PoC rounds with vendors for compute and data resources.
• Lead projects through the full software lifecycle including CI/CD and on-call support.

Skills

HPC infrastructure

Linux troubleshooting

Automation

Python scripting

PyTorch/NCCL/Ray/DeepSpeed

Slurm

Kubernetes

GPU hardware

Education

Bachelor's degree in Computer Science or Computer Engineering

Tools

Ansible

Terraform

Helm

Python/Bash scripting

NVIDIA GPU hardware

Slurm/Kubernetes cluster management

Job description

Veeda AI in Toronto, Ontario seeks a Member of Technical Staff to advance AI infrastructure for multimodal foundation world models. You will own GPU cluster operations, security, data transmission, and end-to-end production observability.

The role emphasizes hands-on HPC expertise, kernel and networking tuning, IaC automation, and collaboration with model and data teams to scale compute and data resources.