Hardware Systems Architect

Anthropic

New York (NY)

On-site

USD 320,000 - 485,000

Full time

13 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive compensation
Equity donation matching
Generous vacation and parental leave
Flexible working hours

Job summary

Anthropic is seeking senior hardware systems architects and technical leads to own architecture across compute, power, cooling, interconnect, and reliability for AI workloads. You will write high-level specs, guide bring-up, and coordinate with ML performance, infra software, supply chain, and vendor partners.

This role requires deep hands-on domain expertise, experience scaling hardware, and strong technical leadership to drive validation and AI-assisted design practices.

Qualifications

  • Deep hands-on expertise in at least one core hardware-systems domain (e.g., interconnect, power, thermal) for large-scale compute or networking systems.
  • Experience owning hardware system architecture at scale — machine, rack, row, and cluster — and authoring specifications and requirements.
  • Experience taking hardware from architecture through bring-up and high-volume production deployment.
  • Experience working with external hardware vendors and partners — reviewing their designs and holding them to a specification.
  • Ability to reason about trade-offs across adjacent hardware domains (e.g., interconnect power thermal mechanical).
  • Track record of technical leadership — owning directional decisions and their consequences, and driving alignment across teams.

Responsibilities

  • Own system path-finding and architecture for your domain across the breadth of compute Anthropic deploys.
  • Write and own high-level requirements and specifications — system, board, interface, rack.
  • Review partner and vendor designs against our requirements and surface risks early.
  • Drive interconnect and networking architecture that ties our systems together.
  • Drive board-, chassis-, and system-level architecture with partners and manage power/thermal budgeting.
  • Develop performance simulations, hardware models, and what-if analyses.
  • Define validation, bring-up, and qualification strategy for new platforms.
  • Partner with ML performance and infra software teams so hardware decisions land well for workloads.

Skills

Hardware architecture
System bring-up
Vendor collaboration
Trade-off analysis
Technical leadership
Autonomy in fast-moving env

Education

Degree in EE/CE/ME/CS or related

Tools

Hardware design specs
BMC/firmware basics

Job description

About Anthropic

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.

About The Role

Anthropic trains and serves frontier AI models on some of the largest and most diverse accelerator fleets in the world, and the hardware those models run on is one of the most direct levers we have on capability, cost, and reliability. Our Hardware Systems team owns the system-level architecture of that compute — from the package boundary out through boards, racks, interconnect, power, cooling, and the datacenter interface.

We're hiring senior hardware systems architects and technical leads who can work broadly across the hardware stack and go deep where it's needed, and who have the judgment to make and own directional calls — what to build, what to buy, what to co-design with a partner. You'll set architecture, write the specs that partners and internal teams build against, and own the validation and qualification strategy that proves the result.

The skillsets we need span power, cooling, mechanical, interconnect, signal integrity, data and control plane, system management, reliability and serviceability — applied across networking, compute, storage, and accelerator systems.

You’ll work closely with our ML performance, infrastructure software, supply chain, and datacenter teams, and directly with hardware vendors and partners across the stack. And because this is Anthropic, you’ll have Claude as a genuine collaborator — we expect this team to push on what AI-assisted hardware design and review can look like.

Key responsibilities
  • Own system path-finding and architecture for your domain across the breadth of compute Anthropic deploys — from concept and requirements through spec, design review, and deployment — and act as a reviewer and thought partner across the others.
  • Write and own high-level requirements and specifications — system, board, interface, rack — that partners and internal teams build against.
  • Review partner and vendor designs against our requirements, make the build / buy / co-design calls with supply chain and partnership teams, and surface misalignment or schedule risk early enough to act on it.
  • Drive the interconnect and networking architecture that ties our systems together — scale-up and scale-out fabrics, NICs and switches, optics, and topology.
  • Drive board-, chassis-, and system-level architecture with our partners — major component placement, PCB architecture, connector and cable design, and power and thermal budgeting — at the chassis, rack, and data-hall level.
  • Develop performance simulations, hardware models, and "what-if" scenarios to evaluate and choose between candidate hardware architectures.
  • Define validation, bring-up, and qualification strategy for new platforms — including the telemetry and reliability targets they need to hit in the fleet — and track the technology roadmaps and vendor landscape that shape what we deploy in the short and long term.
  • Partner with ML performance and infrastructure software teams so hardware decisions land well for the workloads that actually run on them.
  • Help shape how hardware engineering operates at Anthropic — develop and apply AI-assisted approaches to design, spec review, and validation; establish review forums, spec standards, and partner engagement.
Minimum Qualifications
  • Deep, hands-on expertise in at least one core hardware-systems domain (e.g., interconnect, power, thermal) for large-scale compute or networking systems.
  • Experience owning hardware system architecture at scale — machine, rack, row, and cluster — and authoring specifications and requirements.
  • Experience taking hardware from architecture through bring-up and high-volume production deployment.
  • Experience working with external hardware vendors and partners — reviewing their designs and holding them to a specification.
  • Ability to reason about trade-offs across adjacent hardware domains (e.g., interconnect power thermal mechanical) rather than within a single one.
  • Track record of technical leadership — owning directional decisions and their consequences, and driving alignment across teams and partners.
  • Comfort operating with high autonomy and limited process in a fast-moving, ambiguous environment.
  • Strong written communication — you’ll write specs and reviews that many teams depend on.
Preferred Qualifications
  • 8+ years in hardware systems architecture or engineering for hyperscale, HPC, AI/ML, or high-end networking platforms.
  • Experience with AI accelerator systems (GPU, TPU, or other custom ASIC platforms) and their scale-up / scale-out fabrics.
  • Familiarity with the chip-package-system interface and co-design.
  • Experience establishing a new function, program, or engineering practice.
  • Comfort working with — and curiosity about pushing — AI tools as part of an engineering workflow.
  • Degree in EE, CE, ME, CS, or a related field, or equivalent experience.
  • Depth in one or more of:
    • High-speed SerDes, PCIe/CXL, Ethernet/InfiniBand, and optical interconnect.
    • BMC and platform firmware, hardware root of trust, and secure boot.
    • 48V/HVDC power delivery and direct liquid cooling.
    • Fleet-scale reliability engineering and RAS architecture.
    • Signal and power integrity.
Representative projects
  • Define the scale-up and scale-out interconnect architecture for a next-generation training platform, from link budget and topology through switch / NIC / optics selection and the bring-up and validation plan.
  • Architect the management and control plane for a new hardware system: BMC and host control, power / reset sequencing, secure boot and attestation, and the telemetry surface the fleet needs.
  • Own the rack-level power and thermal architecture for a liquid-cooled accelerator rack, and the interface spec between that rack and the datacenter that hosts it.
  • Build the reliability model and RAS strategy for a multi-thousand-node fleet — failure budgets, derating policy, telemetry requirements, and serviceability targets — and drive the design changes that hit them.
  • Run the technical evaluation of a partner's proposed system design against our requirements, write up where it falls short, and drive the changes end to end.
  • Prototype an AI-assisted workflow for partner design review and spec consistency checking, and put it to work on a live platform.

The annual compensation range for this role is listed below.

Annual Salary

$320,000—$485,000 USD

Logistics

Minimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience
Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience
Minimum years of experience: Years of experience required will correlate with the internal job level requirements for the position
Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices
Visa sponsorship: We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this

How We're Different

We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills.

Come work with us!

Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues.

Guidance on Candidates' AI Usage

Learn about our policy for using AI in our application process.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Hardware Systems Architect
Hardware Systems Architect

Anthropic • San Francisco (CA)

On-site
USD 320,000 - 485,000
Competitive compensation
Equity donation matching
Generous vacation
+2
Hardware Systems Architect
Hardware Systems Architect

Anthropic • Seattle (WA)

On-site
USD 320,000 - 485,000
Equity matching
Vacation & parental leave
Flexible hours
+1
Technical Program Manager, Hardware Systems
Technical Program Manager, Hardware Systems

Anthropic • New York (NY)

Hybrid
USD 365,000 - 435,000
Equity donation matching
Generous vacation & parental leave
Flexible working hours
Technical Program Manager, Hardware Systems
Technical Program Manager, Hardware Systems

Anthropic • New York (NY)

Hybrid
USD 365,000 - 435,000
Hardware Lab Manager
Hardware Lab Manager

Anthropic • New York (NY)

On-site
USD 320,000 - 405,000
Visa sponsorship
Data Center Engineer, Reliability & Infrastructure Management – Compute Supply
Data Center Engineer, Reliability & Infrastructure Management – Compute Supply

Anthropic • New York (NY)

On-site
USD 320,000 - 405,000
Competitive compensation
Equity donation matching
Generous vacation
+3
Data Center Engineer, Reliability & Infrastructure Management – Compute Supply
Data Center Engineer, Reliability & Infrastructure Management – Compute Supply

Anthropic • San Francisco (CA)

Hybrid
USD 320,000 - 405,000
Staff+ Infrastructure Engineer, Cluster Infrastructure
Staff+ Infrastructure Engineer, Cluster Infrastructure

Anthropic • Seattle (WA)

Hybrid
USD 320,000 - 485,000
Equity donation matching
Generous vacation and parental leave
Flexible working hours
+1
Silicon Engineer
Silicon Engineer

Anthropic • San Francisco (CA)

Hybrid
USD 320,000 - 485,000
Engineering Manager — Accelerator Platform Lead
Engineering Manager — Accelerator Platform Lead

Anthropic • San Francisco (CA)

On-site
Confidential