Senior OpenStack & GPU Infra Architect - Remote

OCI Threads

United States

Remote

USD 140,000 - 220,000

Full time

10 days ago
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

OCI Threads is seeking a Senior OpenStack & GPU Infrastructure Architect to join our team remotely. You will own architecture workshops, create HLD/LLD, and drive IaC deployments across private cloud clusters featuring OpenStack and NVIDIA GPUs.

You will design compute, network, storage, and security architectures, perform capacity planning, validate driver stacks and DCGM, and lead complex troubleshooting in a fast-paced enterprise environment.

Qualifications

  • Bachelor's degree in Computer Science, Electrical Engineering, Information Technology, or a related field.
  • Minimum 8+ years of professional IT infrastructure architecture and cloud engineering experience.
  • Strong, proven hands-on experience designing and implementing enterprise OpenStack private cloud environments.
  • Deep technical knowledge of OpenStack compute, networking (Neutron), and storage architecture.
  • Strong Linux infrastructure administration and automation / Infrastructure-as-Code (IaC) experience.
  • Hands-on experience with NVIDIA GPU infrastructure, DCGM, Fabric Manager, and NCCL benchmarking.
  • Demonstrated expertise in High Availability (HA), disaster recovery, performance tuning, and complex troubleshooting.
  • Ability to independently develop comprehensive HLD, LLD, and implementation architecture documentation.
  • Professional availability for remote employment.

Responsibilities

  • Lead OpenStack architecture workshops, High-Level Design (HLD), and Low-Level Design (LLD) development.
  • Design enterprise compute, network, storage, GPU acceleration, and security infrastructure architectures.
  • Perform comprehensive capacity planning, infrastructure sizing, and hardware resource forecasting.
  • Design and support hardened Linux-based OpenStack environments across control and compute planes.
  • Lead Infrastructure-as-Code (IaC) based OpenStack deployment across control and compute nodes.
  • Configure, administer, and troubleshoot OpenStack core services including Nova, Neutron, Cinder, Glance, Placement, and Horizon.
  • Design and enable high-performance GPU workloads and container runtime integration.
  • Review BIOS, BMC, GPU/HGX, NVMe, and NIC firmware compatibility across enterprise hardware.
  • Implement, configure, and validate the NVIDIA driver stack, Fabric Manager, and Data Center GPU Manager (DCGM).
  • Perform NCCL bandwidth testing, GPU burn-in, and performance validation across AI cluster nodes.
  • Lead functional, performance, resiliency, failover, and disaster recovery testing.
  • Provide L3 OpenStack architecture, platform troubleshooting, and operational support.

Skills

OpenStack
Neutron Networking
Linux Administration
Infrastructure-as-Code (IaC)
NVIDIA GPU infrastructure
DCGM
NCCL
HA / DR
Remote work
Documentation

Education

Bachelor's degree in CS/EE/IT

Tools

Fabric Manager
NVIDIA DCGM tooling
Kubernetes

Job description

OCI Threads is seeking a Senior OpenStack & GPU Infrastructure Architect to join our team remotely. You will own architecture workshops, create HLD/LLD, and drive IaC deployments across private cloud clusters featuring OpenStack and NVIDIA GPUs.

You will design compute, network, storage, and security architectures, perform capacity planning, validate driver stacks and DCGM, and lead complex troubleshooting in a fast-paced enterprise environment.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Senior OpenStack & GPU Infra Architect
Remote Senior OpenStack & GPU Infra Architect

OCI Threads • United States

Remote
USD 180,000 - 240,000
Senior OpenStack & GPU Infrastructure Architect | OCI Threads | Remote
Senior OpenStack & GPU Infrastructure Architect | OCI Threads | Remote

OCI Threads • United States

Remote
USD 140,000 - 220,000
Senior OpenStack & GPU Infrastructure Architect (Position 2) | OCI Threads | Remote
Senior OpenStack & GPU Infrastructure Architect (Position 2) | OCI Threads | Remote

OCI Threads • United States

Remote
USD 180,000 - 240,000
Remote Senior GPU Cluster Architect for AI Infrastructure
Remote Senior GPU Cluster Architect for AI Infrastructure

Orion Placement • United States

On-site
USD 140,000 - 220,000
Bonus
Equity
Senior Cloud & HPC DevOps Architect
Senior Cloud & HPC DevOps Architect

Embedded Shishya • United States

Remote
USD 180,000 - 260,000
Senior GPU Infra Engineer — Remote
Senior GPU Infra Engineer — Remote

Nscale • Seattle (WA)

On-site
USD 120,000 - 170,000
Remote-first culture
Equity plan
Flexible workplace
Senior AI Infra Architect - GPU Clusters & NVLink (Remote)
Senior AI Infra Architect - GPU Clusters & NVLink (Remote)

NVIDIA Corporation • Santa Clara (CA), Northern (KY)

Hybrid
USD 184,000 - 357,000
Lead GPU Cluster Architect - AI Infra (Remote)
Lead GPU Cluster Architect - AI Infra (Remote)

Praxy • Northern (KY)

Hybrid
USD 184,000 - 318,000
Health insurance
401(k) plan
Parental leave
+1
Senior GPU Cloud Infrastructure Engineer
Senior GPU Cloud Infrastructure Engineer

Hyperbolic • San Francisco (CA)

On-site
USD 180,000 - 240,000
Technical Lead - GPU Infrastructure (Fully Remote)
Technical Lead - GPU Infrastructure (Fully Remote)

Jobgether SRL • United States

Remote
USD 170,000 - 250,000