Remote GPU Cluster Architect - AI Infrastructure Leader

Jobgether SRL; United States; Remote; USD 184,000 - 318,000; Full time

Benefits offered by this job

Medical, dental, vision insurance

Remote work reimbursement

RSUs may be available

401(k) with company match

Parental leave

Career growth opportunities

Job summary

Jobgether SRL, on behalf of a partner, seeks a GPU Cluster Architect based in the United States. This is a remote, high-impact role focused on designing next-generation AI infrastructure at massive scale, making end-to-end architectural decisions across GPU compute, networking, storage, reliability, and control planes.

You will model workloads for LLM training and inference, collaborate with site reliability, networking, storage, and data center teams, and drive automation and telemetry

Qualifications

• 5+ years designing and architecting large-scale GPU clusters.
• Deep understanding of GPU architectures (NVIDIA/AMD).
• Experience with InfiniBand and RoCE networking.
• Ability to analyze workloads for latency and bandwidth.
• Experience with automation and telemetry using Python or Go.

Responsibilities

• Architect scalable GPU cluster topologies across compute, storage, and control planes.
• Define architectures to support AI/ML workloads across data centers.
• Model workload requirements for LLM training and inference.
• Design high-throughput, low-latency networking at POD and data-center scale.
• Collaborate with data center, networking, and storage teams to deploy architectures.
• Contribute to automation and telemetry initiatives for visibility and reliability.

Skills

GPU cluster design

Networking

InfiniBand/RoCE

Automation scripting (Python/Go)

Tools

InfiniBand HDR/NDR

Job description

Jobgether SRL, on behalf of a partner, seeks a GPU Cluster Architect based in the United States. This is a remote, high-impact role focused on designing next-generation AI infrastructure at massive scale, making end-to-end architectural decisions across GPU compute, networking, storage, reliability, and control planes.

You will model workloads for LLM training and inference, collaborate with site reliability, networking, storage, and data center teams, and drive automation and telemetry