Staff HPC Systems Architect

Lambda

San Jose (CA)

On-site

USD 180,000 - 260,000

Full time

4 days ago
Be an early applicant
Application generator

An application made for this job — a tailored resume and cover letter that speak straight to the posting.

Get past ATS filters

Benefits offered by this job

Health, dental, and vision coverage
Equity compensation
401k with 2% company match
Wellness stipend
Commuter stipend
Flexible paid time off

Job summary

Lambda, The Superintelligence Cloud, is seeking a Senior Compute Platform Architect to lead the design of scalable AI/ML compute infrastructure across bare metal and cloud deployments. You will define architecture standards, drive performance tuning, and guide hardware/software tradeoffs for density and efficiency.

You will collaborate with product and engineering teams, assess CPU/GPU/accelerator technologies, and mentor cross-functional staff.

Qualifications

  • Proven track record architecting 10k+ GPU HPC or cloud compute platforms.
  • Deep knowledge of CPU/GPU architectures and memory hierarchies.
  • Experience with high-bandwidth, low-latency fabrics (NVLink, InfiniBand, RoCE).

Responsibilities

  • Architect scalable compute platforms optimized for AI/ML, simulation, and high-throughput workloads.
  • Develop compute system standards and design patterns for performance and maintainability.
  • Evaluate CPU/GPU/accelerator tech and guide tradeoffs for density, power, cooling, and TCO.
  • Collaborate with product and engineering to map workloads to platform capabilities across bare metal and cloud deployments.
  • Translate ambiguous business needs into measurable platform requirements and architecture decisions.
  • Define compute platform roadmaps and reference designs for hardware, firmware, and rack/clusters.
  • Lead validation and performance characterization during new platform introductions.
  • Mentor engineers on compute performance tuning, sizing, and architectural decisions.

Skills

CPU architectures
GPU architectures
Memory hierarchies
High-bandwidth fabrics
Resource scheduling
Thermal optimization
Power optimization
Compute lifecycle management
Orchestration layers
Analytical skills
Communication skills
Ownership / self-starter

Tools

Slurm
Kubernetes
GPU virtualization

Job description

Lambda, The Superintelligence Cloud, is a leader in AI cloud infrastructure serving tens of thousands of customers. Our customers range from AI researchers to enterprises and hyperscalers. Lambda's mission is to make compute as ubiquitous as electricity and give everyone the power of superintelligence. One person, one GPU.

If you'd like to build the world's best AI cloud, join us.

*Note: This position requires presence in our San Jose, San Francisco, or Bellevue office location 4 days per week; Lambda’s designated work from home day is currently Tuesday.

What You’ll Do
  • Architect and define scalable compute platforms optimized for AI/ML, simulation, and high-throughput workloads.

  • Develop compute system standards and design patterns to ensure consistency, performance, and maintainability across infrastructure.

  • Evaluate emerging CPU, GPU, and accelerator technologies, owning architectural tradeoff decisions that impact compute density, power, cooling, and total cost.

  • Collaborate with product and engineering teams to map workload requirements to compute platform capabilities across bare metal and cloud deployments.

  • Experience converting ambiguous business or customer needs into measurable platform requirements, technical specifications, acceptance criteria, and architecture decisions.

  • Define compute platform roadmaps and architectural reference designs that guide hardware selection, firmware baselines, rack-level, and cluster design.

  • Act as a technical lead during new platform introductions, guiding validation and performance characterization efforts.

  • Mentor systems engineers and cross-functional stakeholders on compute performance tuning, sizing, and architectural decisions.

You
  • Proven experience (7+ years) architecting large-scale 10k-100k+ GPU HPC or cloud compute platforms.

  • Deep knowledge of CPU/GPU architectures, memory hierarchies, and accelerator topologies.

  • Experience designing systems around high-bandwidth, low-latency fabrics (NVLink, InfiniBand, and RoCE).

  • Strong understanding of system performance tuning, resource scheduling, thermal and power optimization, and compute lifecycle management.

  • Comfortable working across hardware and software boundaries, especially at the intersection of compute architecture, OS behavior, and orchestration layers.

  • Skilled at balancing architectural tradeoffs for density, power efficiency, cooling, and performance.

  • Strong analytical and communication skills, with a track record of influencing technical strategy across teams.

  • Strong ownership and can do attitude, self-starter who feels comfortable working in ambiguity.

Nice to Have
  • Hands-on experience with AI/ML workloads and their compute performance characteristics.

  • Familiarity with orchestration tools used in HPC. (Slurm, Kubernetes, etc)

  • Experience with virtualization technologies, specifically GPU virtualization.

  • Exposure to hardware validation, vendor collaboration, and long-term OEM roadmap alignment.

  • Background in compute telemetry, real-time performance profiling, or large-scale A/B infrastructure testing.

Salary Range Information

The annual salary range for this position has been set based on market data and other factors. However, a salary higher or lower than this range may be appropriate for a candidate whose qualifications differ meaningfully from those listed in the job description.

About Lambda
  • Founded in 2012, with 500+ employees, and growing fast

  • Our investors notably include TWG Global, US Innovative Technology Fund (USIT), Andra Capital, SGW, Andrej Karpathy, ARK Invest, Fincadia Advisors, G Squared, In-Q-Tel (IQT), KHK & Partners, NVIDIA, Pegatron, Supermicro, Wistron, Wiwynn, Gradient Ventures, Mercato Partners, SVB, 1517, and Crescent Cove

  • We have research papers accepted at top machine learning and graphics conferences, including NeurIPS, ICCV, SIGGRAPH, and TOG

  • Our values are publicly available: https://lambda.ai/careers

  • We offer generous cash & equity compensation

  • Health, dental, and vision coverage for you and your dependents

  • Wellness and commuter stipends for select roles

  • 401k Plan with 2% company match (USA employees)

  • Flexible paid time off plan that we all actually use

Equal Opportunity Employer

Lambda is an Equal Opportunity employer. Applicants are considered without regard to race, color, religion, creed, national origin, age, sex, gender, marital status, sexual orientation and identity, genetic information, veteran status, citizenship, or any other factors prohibited by local, state, or federal law.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Staff HPC Systems Architect
Staff HPC Systems Architect

Socket.dev • San Jose (CA)

On-site
USD 180,000 - 240,000
Senior HPC Systems Architect
Senior HPC Systems Architect

Neura Market • San Jose (CA)

Hybrid
USD 180,000 - 240,000
Health, dental, and vision
401k with company match
Wellness stipend
+1
Senior HPC Systems Architect
Senior HPC Systems Architect

Lambda • San Francisco (CA)

Hybrid
USD 180,000 - 240,000
Senior HPC Systems Architect
Senior HPC Systems Architect

The Consensus • San Jose (CA), Northern (KY)

Hybrid
USD 180,000 - 240,000
Cash compensation
Equity compensation
Health, dental and vision coverage
+1
Senior HPC Systems Architect
Senior HPC Systems Architect

Socket.dev • San Jose (CA)

Hybrid
USD 180,000 - 260,000
Senior HPC Platform Hardware Engineer
Senior HPC Platform Hardware Engineer

Neura Market • San Jose (CA)

On-site
USD 180,000 - 280,000
Cash & equity compensation
Health, dental, and vision coverage
Wellness stipends
+1
Senior HPC Platform Hardware Engineer
Senior HPC Platform Hardware Engineer

Lambda Inc. • San Jose (CA)

Hybrid
USD 180,000 - 280,000
Health, dental, and vision coverage
Wellness stipend
Commuter stipend
+2
Senior HPC Systems Validation Engineer
Senior HPC Systems Validation Engineer

Neura Market • San Jose (CA)

Hybrid
USD 180,000 - 230,000
Senior Software Engineer - Core Cloud Platform
Senior Software Engineer - Core Cloud Platform

Neura Market • San Francisco (CA)

Hybrid
USD 180,000 - 240,000
Wellness stipend
Commuter stipend
401k with company match
Senior Software Engineer - Core Cloud Platform
Senior Software Engineer - Core Cloud Platform

Lambda Labs • United States

Hybrid
USD 180,000 - 240,000
Health insurance
Dental insurance
Vision insurance
+5