Hardware Systems Engineer - AI Hardware

Cloudflare, Inc.

Austin (TX)

On-site

USD 140,000 - 190,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Cloudflare, Inc. is seeking a Hardware Systems Engineer to design, qualify, and maintain a worldwide GPU server fleet for AI workloads. You will collaborate with Engineering, Product, Performance, and Sourcing teams to deliver reliable, scalable infrastructure.

You will apply first-principles analysis to optimize compute, interconnects, power, and cooling, while staying ahead of AI hardware trends and tooling needs. This role is based in Austin, TX with global collaboration.

Qualifications

  • AI infrastructure, systems engineering, or hardware platform engineering experience.
  • First-principles understanding of AI accelerator architecture and workload mapping.
  • Hands-on experience qualifying AI server platforms (NCCL tests, NVLink issues, PCIe).
  • Familiarity with rack-scale systems and high-density power and cooling.
  • Scripting and automation in Python, Bash, or Go; Linux sysadmin.

Responsibilities

  • Contribute to the technical requirements and end-to-end delivery of AI infrastructure.
  • Evaluate, select, and qualify AI hardware platforms based on real workload requirements and first-principles analysis.
  • Design and validate rack-scale GPU systems: multi-node topologies, high-speed interconnects, power distribution, and thermal management.
  • Run hands-on qualification: benchmarking, stress testing, failure mode analysis, and vendor RCA.
  • Assess and qualify ODM/OEM server platforms; engage directly with vendors and work through the full technical qualification cycle.
  • Translate AI product and workload requirements into precise infrastructure specifications.
  • Identify gaps in the existing infrastructure stack and drive solutions across hardware, firmware, software, and operations.
  • Stay ahead of the AI hardware landscape and bring informed recommendations.
  • Build tooling and automation to support qualification workflows, performance analysis, and ongoing operational visibility.
  • Communicate your results and updates through blog posts and internal talks

Skills

AI infrastructure
Systems engineering
Hardware qualification
Python scripting
Bash scripting
Go programming
Linux admin
NCCL testing
NVLink / PCIe

Education

Bachelor’s/Master’s/PhD in Computer Engineering / Electrical Engineering / Computer Science

Tools

NVLink
InfiniBand
RoCE
NCCL tests

Job description

About Us

At Cloudflare, we are on a mission to help build a better Internet. Today the company runs one of the world’s largest networks that powers millions of websites and other Internet properties for customers ranging from individual bloggers to SMBs to Fortune 500 companies. Cloudflare protects and accelerates any Internet application online without adding hardware, installing software, or changing a line of code. Internet properties powered by Cloudflare all have web traffic routed through its intelligent global network, which gets smarter with every request. As a result, they see significant improvement in performance and a decrease in spam and other attacks. Cloudflare was named to Entrepreneur Magazine’s Top Company Cultures list and ranked among the World’s Most Innovative Companies by Fast Company.


At Cloudflare, we’re not looking for people who wait for a polished roadmap; we’re looking for the builders who see the cracks in the Internet that everyone else has simply learned to live with. We value candidates who have the instinct to spot a \"normalized\" problem and the AI-native curiosity to create a solution using the latest tools. Our culture is built on iteration, leveraging AI to ship faster today to make it better tomorrow, while ensuring that every improvement, no matter how small, is shared across the team to lift everyone up. If you’re the type of person who values curiosity over bureaucracy, and that AI is a partner in solving tough problems to keep the Internet moving forward, you’ll fit right in.


Available Locations: Austin, Texas | Lisbon, Portugal


About The Department

Cloudflare’s Infrastructure group is responsible for building our global network. Our Hardware Engineering team helps research, develop, test, and deploy new equipment enabling 20% of the world’s internet traffic to be served smoothly. Deployed across 330 cities in 120+ countries, the hardware we select helps improve the security, reliability, and performance of the Internet.


About The Role

We need to make thoughtful infrastructure choices affecting a significant portion of the Internet. Hardware we work with includes GPUs, servers and components, as well as PDUs and network hardware. As a Hardware Systems Engineer, you will work with colleagues on the Engineering teams, Product and Performance teams, and Hardware Sourcing teams to design, qualify and maintain Cloudflare’s worldwide fleet of GPU servers.


What You’ll Do


  • Contribute to the technical requirements and end-to-end delivery of AI infrastructure — compute, networking, storage, power, and cooling — not just the accelerator

  • Evaluate, select, and qualify AI hardware platforms (GPUs, custom ASICs, SmartNICs, storage) based on real workload requirements and first-principles analysis

  • Design and validate rack-scale GPU systems: multi-node topologies, high-speed interconnects (NVLink, InfiniBand, RoCE), power distribution, and thermal management

  • Run hands-on qualification: benchmarking, stress testing, failure mode analysis, and vendor RCA — you close the loop yourself

  • Assess and qualify ODM/OEM server platforms; engage directly with vendors and work through the full technical qualification cycle

  • Translate AI product and workload requirements into precise infrastructure specifications

  • Identify gaps in the existing infrastructure stack and drive solutions across hardware, firmware, software, and operations

  • Stay ahead of the AI hardware landscape — new silicon, new interconnects, new form factors — and bring informed, opinionated recommendations

  • Build tooling and automation to support qualification workflows, performance analysis, and ongoing operational visibility

  • Communicate your results and updates through blog posts and internal talks


Examples Of Desirable Skills, Knowledge And Experience


  • Bachelor’s, Master’s, or PhD degree in Computer Engineering, Electrical Engineering, or Computer Science

  • Experience in AI infrastructure, systems engineering, or hardware platform engineering

  • First-principles understanding of AI accelerator architecture: compute pipelines, memory hierarchy (HBM, GDDR), interconnect topology, and/or how workload characteristics map to hardware capabilities

  • Hands-on experience qualifying AI server platforms — you've run NCCL tests, profiled collective operations, debugged NVLink errors, and chased down PCIe lane misconfigurations

  • Understand rack-scale systems: high-density power (kW/rack, busbar, PDU), liquid cooling (rear-door, direct liquid, immersion), high-speed networking infrastructure, and/or physical layer constraints

  • Experience with AI/ML frameworks (vllm, sglang) at the systems level — you understand what they demand from the hardware and where bottlenecks actually live

  • Familiarity with AI server form factors: HGX, OAC, OAM, UBB, open rack standards, and the tradeoffs between them

  • Scripting and automation skills (Python, Bash, Go and Linux sysadmin); you build tooling to support …


Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Hardware Systems Engineer - AI Hardware
Hardware Systems Engineer - AI Hardware

Cloudflare, Inc. • United States

Hybrid
USD 180,000 - 260,000
Hardware Systems Engineer – AI Hardware
Hardware Systems Engineer – AI Hardware

WebHosting • Austin (TX)

Hybrid
USD 150,000 - 210,000
Equity program
Health benefits
Flexible hybrid work model
Hardware Systems Engineer - AI Hardware
Hardware Systems Engineer - AI Hardware

Mexicoremoto • Austin (TX), San Francisco (CA)

Hybrid
USD 120,000 - 190,000
Equity plan
Health insurance
401(k) plan
+1
Hardware Systems Engineer - AI Hardware
Hardware Systems Engineer - AI Hardware

Remote Genie • Austin (TX)

On-site
USD 140,000 - 210,000
Hardware Systems Engineer - AI Hardware
Hardware Systems Engineer - AI Hardware

Cloudflare, Inc. • San Francisco (CA)

On-site
USD 140,000 - 210,000
Equity plan
Health benefits
401(k) retirement plan
+2
HPC/GPU Hardware /Machine Design Engineer - Member of Technical Staff
HPC/GPU Hardware /Machine Design Engineer - Member of Technical Staff

Designworks Talent • Bellevue (WA)

Hybrid
USD 180,000 - 230,000
Staff Engineer, Infrastructure – HPC & AI Compute
Staff Engineer, Infrastructure – HPC & AI Compute

Cssmerge • San Francisco (CA)

On-site
USD 190,000 - 240,000
AI Hardware Systems Engineer
AI Hardware Systems Engineer

Mexicoremoto • Austin (TX), San Francisco (CA)

Hybrid
USD 120,000 - 190,000
Equity plan
Health insurance
401(k) plan
+1
AI Hardware Systems Engineer — GPU Infra & Performance
AI Hardware Systems Engineer — GPU Infra & Performance

Cloudflare, Inc. • United States

Hybrid
USD 180,000 - 260,000
Software Engineer, Compute Infrastructure
Software Engineer, Compute Infrastructure

OpenAI, Inc. • San Francisco (CA)

On-site
GBP 120,000 - 190,000