Director - Hardware Engineering, AI Infrastructure Systems

Axelera AI

United States

Remote

USD 250,000 - 450,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Pension plan
Extensive employee insurances
Stock options

Job summary

Axelera AI is seeking an entrepreneurial engineering leader to establish and run the AI Infrastructure Systems division. You will build the team, shape the technical roadmap, and own end-to-end delivery of board- and system-level products for two strategic programs targeting enterprise AI, sovereign cloud, and HPC customers.

You will review schematics, power budgets, and firmware stacks, driving NPI, ramp with CM/ODMs, and secure platform resilience.

Qualifications

  • 15+ years in hardware engineering with leadership experience.
  • Proven track record shipping datacenter/server-class hardware at volume.
  • Deep expertise in high-speed interfaces (PCIe Gen4/5/6, CXL) and server power/ VRM design.

Responsibilities

  • Build and lead the Infrastructure Systems engineering team from the ground up.
  • Define roadmaps for board- and system-level server products (PCIe Gen6/CXL cards, OAM modules, baseboards).
  • Own end-to-end execution from concept through bring-up, validation and mass production readiness.

Skills

Hardware leadership
High-speed interfaces (PCIe/CXL)
BMC/firmware expertise
Thermal/Mechanical design
System architecture

Tools

PCIe Gen6/CXL tech
Redfish/IPMI

Job description

About Us

Axelera AI is not your regular deep-tech company. We are creating the next-generation AI platform to support anyone who wants to help advancing humanity and improve the world around us.

In just five years, we have raised a total of $450 million and have built a world-class team of 250+ employees (including 60+ PhDs with more than 40,000 citations), both remotely from 20 different countries and with offices in Belgium, France, Switzerland, Italy, the UK, headquartered at the High Tech Campus in Eindhoven, Netherlands.

We have also launched our Metis™ AI Platform, which achieves a 3-5x increase in efficiency and performance, and have visibility into a strong business pipeline exceeding $100 million.

Our unwavering commitment to innovation has firmly established us as a global industry pioneer.

Are you up for the challenge?

Position Overview

We are looking for an entrepreneurial, technically exceptional engineering leader to establish and run Axelera’s AI Infrastructure Systems division within the AI Integrated Systems (AIS) group. This is a new function, created to realize and deliver our next-generation accelerator silicon into datacenter-class form factors from PCIe accelerator cards and OAM-class modules to full 1U/2U rack systems and dense compute nodes targeting enterprise AI, sovereign cloud and HPC customers.

You will build the team, shape the technical roadmap, and own end-to-end delivery of board- and system-level products for two strategic programmes. You will partner closely with the engineering leadership of the Embedded AI product line within AIS, System and Platform Architecture within R&D, the silicon organisation, the Voyager SDK/software group, and Axelera’s go-to-market teams serving hyperscalers, sovereign AI initiatives and the European HPC ecosystem.

This role is deeply hands-on, owning implementation, validation, and delivery of platform systems. You will review schematics and layouts, challenge power and thermal budgets, shape the BMC and platform-firmware stack, and walk the lab floor during bring-up. Strategic leadership without technical depth will not work here.

Key responsibilities:
  • Build the Infrastructure Systems engineering team from the ground up: hire, structure and mentor a multidisciplinary organisation covering hardware architecture, PCB design, power/thermal/mechanical engineering, firmware and platform validation with in-house and 3rd-party resources

  • Define the technical roadmap for the division’s board- and system-level server products—PCIe Gen6/CXL accelerator cards, OAM modules and UBB baseboards, and full 1U/2U rack systems, evolving toward rack-scale solutions including networking fabric and storage architecture—aligned with the next-generation system and silicon roadmap.

  • Serve as the technical authority across system implementation, including schematics, PCB stack-ups, high-speed signaling (PCIe Gen5/6, CXL, high-speed SerDes), enterprise memory, power delivery and VRM design, SI/PI methodology, and mechanical/thermal integration.

  • Own end-to-end execution from concept through design reviews, bring-up, validation, reliability qualification, DFM/DFT/DFR and mass-production readiness, including NPI and ramp with tier-1 CMs and ODMs. Make the build-vs-partner call on each program leading designs in-house where it differentiates, and co-designing with ODM partners where time-to-market or scale demands it.

  • Drive datacenter-grade platform engineering: BMC-based management, Redfish/IPMI, UEFI/BIOS firmware, secure boot and root-of-trust, platform firmware resilience, enterprise RAS features, and out-of-band telemetry.

  • Lead the thermal and mechanical strategy for high-power accelerator platforms, including air-cooled rack designs and, where appropriate, direct liquid cooling (DLC) and immersion-ready variants.

  • Partner with the Embedded AI engineering leadership within AIS to align board and system-level execution across the two product lines, sharing reference designs, validation assets and CM/ODM relationships wherever it accelerates both streams.

  • Collaborate with Platform Architecture, product management, silicon, SDK and software teams to refine and realize platform requirements (e.g. memory topology, interconnect, power states, telemetry) so that the server products showcase the accelerator’s capabilities at rack and cluster scale.

  • Engage directly with strategic customers, system integrators and ecosystem partners (hyperscalers, sovereign cloud operators, HPC centres, OEMs/ODMs) to shape requirements and win design-ins.

  • Define and enforce engineering processes, documentation standards, validation methodologies and quality gates for the new division, mapped to Axelera’s NPD framework.

  • Identify and mitigate technical risks, resolve engineering escalations, and drive debugging and root-cause analysis during development, qualification and early production.

  • Own the division’s engineering budget, CAPEX, external engineering spend and vendor relationships.

Qualifications:
  • 15+ years in hardware engineering for complex electronics products, with at least 5 years in senior leadership roles running multidisciplinary teams.

  • Proven track record of shipping datacenter- or server-class compute hardware into volume production: accelerator cards, OAM modules, UBB baseboards, GPU/xPU-class server platforms, compute nodes or rack-level systems.

  • Deep expertise in high-speed interfaces (PCIe Gen4/5/6, CXL, high-speed SerDes), server memory, high-current power delivery and VRM design, and high-density PCB layout with rigorous SI/PI methodology.

  • Experience with BMC-based platform management, Redfish/IPMI, UEFI/BIOS or equivalent firmware stacks, secure boot/root-of-trust, and enterprise RAS features.

  • Working knowledge of datacenter thermal and mechanical design: air-cooled 1U/2U chassis, direct liquid cooling and/or immersion-ready platforms, and rack power delivery at 12V, 48V and OCP power-shelf level.

  • Familiarity with datacenter and AI infrastructure compliance and with PCIe and OCP standards.

  • Experience working with tier-1 CMs/ODMs on server-class products, including DFM, MP transfer, yield ramp and sustaining engineering.

  • Hands-on ability to review schematics, layouts, simulation results and lab validation data and to make the call when the team is stuck.

  • Strong strategic thinker, excellent communicator, skilled at decision-making in fast-moving environments, comfortable engaging at C-level with customers and partners.

Preference:
  • Experience building or significantly scaling an engineering team is strongly preferred.

  • Experience with AI accelerator platforms, GPUs or custom silicon in a datacenter context is a strong plus.

  • Exposure to sovereign AI, EuroHPC, HPC or European defence/dual-use datacenter programmes is a plus .

  • Fluent English required; additional European language is a plus.

Location

We offer a flexible working arrangement, with options to:

  • Work from one of our Axelera AI offices (Florence and Milan in Italy, Amsterdam and Eindhoven in the Netherlands, Leuven in Belgium, Paris in France, Zurich in Switzerland, or Bristol in the United Kingdom) if you're already based in the vicinity.

  • Work fully remotely from the US or any European country (incl. the UK) you are already in.

  • Relocate with us and work from Amsterdam or Eindhoven in the Netherlands, or Bologna, Florence or Milan in Italy.

What weoffer

This is your chance to shape and be part of a dynamic, fast-growing, international organisation. We offer an attractive compensation package, including a pension plan, extensive employee insurances and the option to get company shares.

An open culture that supports creativity and continual innovation is awaiting you. Collaborative ownership and freedom with responsibility is characteristic for the way we act and work as a team.

At Axelera AI, we wholeheartedly embrace equal opportunity and hold diversity in the highest regard. Our steadfast commitment is to cultivate a warm and inclusive environment that empowers and celebrates every member of our team. We welcome applicants from all backgrounds to join us in shaping the future of AI.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff AI Application Engineer - Heterogeneous Computing
Staff AI Application Engineer - Heterogeneous Computing

Axelera AI • United States

Remote
USD 160,000 - 260,000
Pension plan
Comprehensive insurance
Stock options
+1
Senior AI Application Engineer - LLM & VLM Enablement
Senior AI Application Engineer - LLM & VLM Enablement

Axelera AI • United States

Remote
USD 150,000 - 230,000
Pension plan
Employee insurances
Company shares
(Senior) Director of Sales - Enterprise AI
(Senior) Director of Sales - Enterprise AI

OpenKrill • United States

Hybrid
USD 250,000 - 380,000
Pension plan
Employee insurances
Company shares
Director of Enterprise AI Sales - Hyperscaler Growth
Director of Enterprise AI Sales - Hyperscaler Growth

Axelera AI • San Francisco (CA)

Hybrid
USD 210,000 - 320,000
Pension plan
Health and life insurances
Company equity/shares
Director Hardware Engineering, KI-Infrastruktursysteme
Director Hardware Engineering, KI-Infrastruktursysteme

Axelera AI • United States

Remote
USD 180,000 - 280,000
Rentenplan
Mitarbeitendenversicherungen
Unternehmensanteile
Director/a de Ingeniería de Hardware, Sistemas de Infraestructura de IA
Director/a de Ingeniería de Hardware, Sistemas de Infraestructura de IA

Axelera AI • United States

Remote
USD 250,000 - 450,000
Pension plan
Comprehensive insurance
Stock options
(Senior) Field Application Engineer - India
(Senior) Field Application Engineer - India

Axelera AI • United States

Remote
USD 31,000 - 57,000
Pension plan
Extensive employee insurances
Company shares
Staff-KI-Anwendungsingenieur:in für heterogenes Computing
Staff-KI-Anwendungsingenieur:in für heterogenes Computing

Axelera AI • United States

Remote
USD 140,000 - 210,000
Rentenplan
Mitarbeitendenversicherung
Unternehmensanteile
Partner Marketing Manager, Global Accounts
Partner Marketing Manager, Global Accounts

Axelera AI • United States

Remote
USD 120,000 - 180,000
Pension plan
Extensive employee insurances
Equity/shares option
Senior AI-Anwendungsingenieur: LLM- und VLM-Enablement
Senior AI-Anwendungsingenieur: LLM- und VLM-Enablement

Axelera AI • United States

Remote
USD 100,000 - 167,000