AI Hardware Systems Engineer: GPU & Server Architect

Cloudflare, Inc.

San Francisco (CA)

On-site

USD 140,000 - 210,000

Full time

13 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Equity plan
Health benefits
401(k) retirement plan
Flexible time off
Parental leave

Job summary

Cloudflare, Inc. is seeking a Hardware Systems Engineer - AI Hardware in Austin, TX to design, qualify, and maintain a global fleet of GPU servers. You will work with Engineering, Product, and Sourcing teams to drive end-to-end hardware qualification across AI compute platforms.

The role requires expertise in AI infrastructure, rack-scale systems, and hands-on benchmarking, with a focus on performance, reliability, and scale. This position emphasizes innovation and cross-team collaboration.

Qualifications

  • Experience in AI infrastructure, systems engineering, or hardware platform engineering.
  • First-principles understanding of AI accelerator architecture: compute pipelines, memory hierarchy, interconnect topology, and workload mapping to hardware.
  • Hands-on experience qualifying AI server platforms with NCCL tests, profiling, and debugging NVLink issues.
  • Knowledge of rack-scale systems: high-density power, liquid cooling, high-speed networking, and physical layer constraints.
  • Experience with AI/ML frameworks at the systems level and understanding hardware demands.

Responsibilities

  • Contribute to the technical requirements and end-to-end delivery of AI infrastructure compute, networking, storage, power, and cooling beyond the accelerator.
  • Evaluate, select, and qualify AI hardware platforms based on workload requirements and first-principles analysis.
  • Design and validate rack-scale GPU systems: multi-node topologies, interconnects, power distribution, and thermal management.
  • Run hands-on qualification: benchmarking, stress testing, failure mode analysis, and vendor RCA.
  • Assess and qualify ODM/OEM server platforms; engage directly with vendors through the full qualification cycle.
  • Translate AI product and workload requirements into precise infrastructure specifications.
  • Identify gaps in the infrastructure stack and drive cross-functional solutions across hardware, firmware, software, and operations.
  • Stay ahead of AI hardware landscape and provide informed recommendations.
  • Build tooling and automation to support qualification workflows, performance analysis, and ongoing visibility.
  • Communicate results through blog posts and internal talks.

Skills

Python
Bash
Go
Linux
NCCL tests
NVLink
InfiniBand
PCIe
Redfish
IPMI

Education

Bachelor/Master/PhD in Computer Engineering, Electrical Engineering or Computer Science

Tools

Redfish
IPMI
NCCL
PCIe

Job description

Cloudflare, Inc. is seeking a Hardware Systems Engineer - AI Hardware in Austin, TX to design, qualify, and maintain a global fleet of GPU servers. You will work with Engineering, Product, and Sourcing teams to drive end-to-end hardware qualification across AI compute platforms.

The role requires expertise in AI infrastructure, rack-scale systems, and hands-on benchmarking, with a focus on performance, reliability, and scale. This position emphasizes innovation and cross-team collaboration.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Hardware Systems Engineer — GPUs & Cluster Infra
AI Hardware Systems Engineer — GPUs & Cluster Infra

Cloudflare, Inc. • Austin (TX)

On-site
USD 140,000 - 190,000
AI Hardware Systems Engineer
AI Hardware Systems Engineer

Mexicoremoto • Austin (TX), San Francisco (CA)

Hybrid
USD 120,000 - 190,000
Equity plan
Health insurance
401(k) plan
+1
AI Hardware Systems Architect
AI Hardware Systems Architect

Remote Genie • Austin (TX)

On-site
USD 140,000 - 210,000
AI Hardware Systems Engineer - GPU & Rack-Scale
AI Hardware Systems Engineer - GPU & Rack-Scale

WebHosting • Austin (TX)

Hybrid
USD 150,000 - 210,000
Equity program
Health benefits
Flexible hybrid work model
AI Hardware Systems Engineer — GPU Infra & Performance
AI Hardware Systems Engineer — GPU Infra & Performance

Cloudflare, Inc. • United States

Hybrid
USD 180,000 - 260,000
Cloud AI Hardware Architect — GPU Server Systems
Cloud AI Hardware Architect — GPU Server Systems

Amazon Web Services (AWS) • Denver (CO)

On-site
USD 159,000 - 215,000
GPU-Accelerated AI Cloud Hardware Architect
GPU-Accelerated AI Cloud Hardware Architect

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 157,000 - 213,000
Health insurance
RSUs and competitive benefits
Paid time off
Senior Cloud Server Hardware Architect (GPU/AI)
Senior Cloud Server Hardware Architect (GPU/AI)

Akamai Technologies, Inc. • Cambridge (MA)

On-site
USD 121,000 - 219,000
Health benefits
401K savings plan
Equity awards
+2
Hardware Systems Engineer - AI Hardware
Hardware Systems Engineer - AI Hardware

Cloudflare, Inc. • Austin (TX)

On-site
USD 140,000 - 190,000
Senior Cloud GPU Hardware Architect for AI Servers
Senior Cloud GPU Hardware Architect for AI Servers

Amazon Web Services (AWS) • Austin (TX)

On-site
USD 159,000 - 215,000
Health insurance
401(k) matching
Paid time off
+1