Senior GPU Infrastructure Engineer - AI Infrastructure

Hamilton Barnes; Texas; On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Potential equity/bonus

Job summary

A leading GPUaaS provider in the US is seeking a hands-on engineer to build and operate NVIDIA-powered GPU clusters. This role offers the opportunity to work with cutting-edge technology while taking ownership of greenfield infrastructure. Responsibilities include designing and managing GPU cloud setups, optimizing performance for AI workloads, and collaborating across teams. The ideal candidate has expertise with NVIDIA technology, OpenStack, and a strong Linux background. Competitive salary and potential equity available.

Qualifications

• Strong hands-on experience with NVIDIA GPU infrastructure and networking stack.
• Solid production experience operating OpenStack environments.
• Deep knowledge of Linux systems in high-performance environments.

Responsibilities

• Design, deploy, and operate GPU clusters using NVIDIA networking technologies.
• Build and manage GPU cloud infrastructure using OpenStack.
• Configure and maintain high-performance networking for AI workloads.

Skills

NVIDIA GPU infrastructure

OpenStack

Linux systems

AI/ML training and inference

Networking technologies

Job description

Join a newly funded GPUaaS provider building high-performance AI infrastructure from the ground up in Houston, Texas. This is a hands‑on engineering role focused on deploying and operating NVIDIA‑powered GPU clusters designed for large‑scale AI training and inference workloads.

You’ll be one of the first technical hires on the ground, with direct ownership over GPU networking and cloud infrastructure, shaping how the platform is built, scaled, and operated. The environment is greenfield, fast‑moving, and highly technical, with real influence over architectural decisions.

If you want to work daily with cutting‑edge NVIDIA GPU stacks, own core infrastructure rather than inherit it, and join early at a well‑funded GPUaaS company, this role offers rare depth and impact.

Interested? Get in touch and apply today.

Responsibilities:

• Design, deploy, and operate GPU clusters using NVIDIA networking technologies (InfiniBand, NVLink, RoCE).
• Build and manage GPU cloud infrastructure using OpenStack as the core control plane.
• Configure and maintain high‑performance networking for AI workloads, optimising latency, throughput, and reliability.
• Support provisioning, scaling, and lifecycle management of GPU nodes and tenant environments.
• Work closely with hardware, datacenter, and platform teams to ensure tight integration between compute, network, and storage layers.
• Troubleshoot complex performance and connectivity issues across GPU, network, and virtualisation layers.
• Contribute to automation, documentation, and operational best practices.

Skills/Must have:

• Strong hands‑on experience with NVIDIA GPU infrastructure and networking stack (InfiniBand, RoCE, NCCL, CUDA‑aware networking).
• Solid production experience operating OpenStack environments (Nova, Neutron, Cinder; GPU passthrough a plus).
• Deep Linux systems knowledge in high‑performance or large‑scale environments.
• Experience supporting AI/ML training or inference workloads at scale.
• Comfortable working on‑site 5 days per week in Houston.
• Ability to operate autonomously in an early‑stage, high‑ownership environment

Benefits:

• Potential equity/bonus

Salary:

• $120,000 – $160,000 base (depending on experience)