Remote Senior OpenStack & GPU Infra Architect

OCI Threads

United States

Remote

USD 180,000 - 240,000

Full time

11 days ago
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

OCI Threads is seeking a Senior OpenStack & GPU Infrastructure Architect to lead architecture, design, and deployment of private cloud and AI infrastructure in a remote capacity. You will own high-level and low-level designs, drive IaC deployments, and validate multi-node OpenStack environments with NVIDIA GPU integration.

Responsibilities include capacity planning, configuring OpenStack core services, benchmarking NCCL, validating DCGM workflows, and producing comprehensive runbooks and

Qualifications

  • Bachelor’s degree in a related field.
  • 8+ years of professional IT infrastructure architecture and cloud engineering experience.
  • Hands-on experience designing and implementing enterprise OpenStack private cloud environments.
  • Deep technical knowledge of OpenStack compute, networking, and storage architecture.
  • Strong Linux administration and automation / IaC experience.
  • NVIDIA GPU infrastructure experience including DCGM, Fabric Manager, and NCCL benchmarking.
  • HA, disaster recovery, performance tuning, and complex troubleshooting expertise.
  • Ability to develop HLD/LLD documentation.

Responsibilities

  • Lead OpenStack architecture workshops, HLD, and LLD development.
  • Design compute, network, storage, GPU acceleration, and security infrastructures.
  • Perform capacity planning, sizing, and hardware resource forecasting.
  • Design and support hardened Linux-based OpenStack environments.
  • Lead IaC-based OpenStack deployment across control and compute nodes.
  • Configure and troubleshoot OpenStack core services (Nova, Neutron, Cinder, Glance, Placement, Horizon).
  • Design GPU workloads and container runtime integration.
  • Review firmware compatibility for enterprise hardware (BIOS/BMC/GPU/NIC).
  • Implement and validate NVIDIA driver stack, Fabric Manager, and DCGM.
  • Perform NCCL bandwidth tests and GPU burn-in across multi-node clusters.
  • Lead testing for availability, resiliency, failover, and disaster recovery.
  • Provide L3 OpenStack architecture and operational support.

Skills

OpenStack
Linux
Infrastructure as Code
NVIDIA GPU infrastructure
NCCL benchmarking
DCGM
High Availability
Disaster recovery

Education

Bachelor’s degree in Computer Science, Electrical Engineering, Information Technology, or a related field

Tools

OpenStack Nova
OpenStack Neutron
OpenStack Cinder
OpenStack Glance
OpenStack Horizon
Fabric Manager
NVIDIA DCGM
NVIDIA driver stack

Job description

OCI Threads is seeking a Senior OpenStack & GPU Infrastructure Architect to lead architecture, design, and deployment of private cloud and AI infrastructure in a remote capacity. You will own high-level and low-level designs, drive IaC deployments, and validate multi-node OpenStack environments with NVIDIA GPU integration.

Responsibilities include capacity planning, configuring OpenStack core services, benchmarking NCCL, validating DCGM workflows, and producing comprehensive runbooks and

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior OpenStack & GPU Infra Architect - Remote
Senior OpenStack & GPU Infra Architect - Remote

OCI Threads • United States

Remote
USD 140,000 - 220,000
Senior OpenStack & GPU Infrastructure Architect | OCI Threads | Remote
Senior OpenStack & GPU Infrastructure Architect | OCI Threads | Remote

OCI Threads • United States

Remote
USD 140,000 - 220,000
Senior OpenStack & GPU Infrastructure Architect (Position 2) | OCI Threads | Remote
Senior OpenStack & GPU Infrastructure Architect (Position 2) | OCI Threads | Remote

OCI Threads • United States

Remote
USD 180,000 - 240,000
Remote Senior GPU Cluster Architect for AI Infrastructure
Remote Senior GPU Cluster Architect for AI Infrastructure

Orion Placement • United States

On-site
USD 140,000 - 220,000
Bonus
Equity
Senior Cloud & HPC DevOps Architect
Senior Cloud & HPC DevOps Architect

Embedded Shishya • United States

Remote
USD 180,000 - 260,000
Senior AI Infra Architect - GPU Clusters & NVLink (Remote)
Senior AI Infra Architect - GPU Clusters & NVLink (Remote)

NVIDIA Corporation • Santa Clara (CA), Northern (KY)

Hybrid
USD 184,000 - 357,000
Lead GPU Cluster Architect - AI Infra (Remote)
Lead GPU Cluster Architect - AI Infra (Remote)

Praxy • Northern (KY)

Hybrid
USD 184,000 - 318,000
Health insurance
401(k) plan
Parental leave
+1
Senior ML Infra Engineer - Scale GPU Clusters, Remote
Senior ML Infra Engineer - Scale GPU Clusters, Remote

AI Breaking Wire • San Francisco (CA), Northern (KY)

Hybrid
USD 320,000 - 500,000
Equity
Medical/Dental/Vision coverage
Unlimited PTO
+1
Remote HPC Systems Administrator - GPU & AI Infra
Remote HPC Systems Administrator - GPU & AI Infra

5C Group • Springfield (OH)

Remote
USD 120,000 - 135,000
Career growth
Industry leadership
Entrepreneurial culture
+1
Remote GPU Cluster Architect - AI Infrastructure Leader
Remote GPU Cluster Architect - AI Infrastructure Leader

Jobgether SRL • United States

Remote
USD 184,000 - 318,000
Medical, dental, vision insurance
Remote work reimbursement
RSUs may be available
+3