AI Infrastructure Architect — Scalable GPU Compute

EngineersOfAI

Sunnyvale (CA)

On-site

USD 150,000 - 200,000

Full time

14 days+
Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

EngineersOfAI in Sunnyvale, California is seeking an Architect for AI Infrastructure to design and evolve their foundational cloud compute systems. The successful candidate will focus on large-scale AI workloads across GPU clusters and multi-cloud environments.

With over 10 years of experience in distributed systems, the role requires strong technical leadership and mentorship skills. Ideal candidates will have a deep understanding of petabyte-scale data architecture, emphasizing rapid model deployment and operational excellence.

Qualifications

  • 10+ years designing and building large-scale distributed systems.
  • Experience enabling large-scale AI training and inference in GPU clusters.
  • Deep understanding of petabyte-scale data architecture.

Responsibilities

  • Define and evolve architecture for training and inference workloads.
  • Design systems for fast, reliable access to high-volume data.
  • Build foundations for large-scale AI workloads across cloud environments.
  • Act as a partner to leadership in aligning compute investments.
  • Uplift the engineering organization through mentorship.

Skills

Large-scale distributed systems design
GPU-based cloud infrastructure
Technical leadership
Mentorship

Education

Advanced degree in Computer Science, Electrical Engineering, or related field

Job description

EngineersOfAI in Sunnyvale, California is seeking an Architect for AI Infrastructure to design and evolve their foundational cloud compute systems. The successful candidate will focus on large-scale AI workloads across GPU clusters and multi-cloud environments.

With over 10 years of experience in distributed systems, the role requires strong technical leadership and mentorship skills. Ideal candidates will have a deep understanding of petabyte-scale data architecture, emphasizing rapid model deployment and operational excellence.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Infrastructure Engineer — Global GPU Cloud
Senior AI Infrastructure Engineer — Global GPU Cloud

Together Computer Inc • United States

Remote
USD 160,000 - 230,000
Startup equity
Health insurance
Remote work flexibility
Senior GPU Cluster Architect for AI Infra at Scale
Senior GPU Cluster Architect for AI Infra at Scale

Partner Company • United States

Remote
USD 184,000 - 318,000
Medical insurance
Dental insurance
Vision insurance
+1
AI Infrastructure Engineer: HPC, GPUs & Agentic AI
AI Infrastructure Engineer: HPC, GPUs & Agentic AI

Accenture • Walnut Creek (CA)

On-site
USD 94,000 - 266,000
Senior GPU Compute Solutions Architect
Senior GPU Compute Solutions Architect

Computacenter AG & Co. oHG • Northern (KY)

Hybrid
USD 190,000 - 230,000
Senior GPU Infra Architect for Scalable AI Compute
Senior GPU Infra Architect for Scalable AI Compute

AI Chopping Block, Inc. • Costa Mesa (CA), Northern (KY)

Hybrid
USD 166,000 - 220,000
Global AI Compute Infrastructure Engineer
Global AI Compute Infrastructure Engineer

OpenAI • United States

On-site
USD 150,000 - 300,000
Senior AI Infrastructure Lead - GPU Clusters & Model Serving
Senior AI Infrastructure Lead - GPU Clusters & Model Serving

Outsourceit • San Francisco (CA)

On-site
USD 120,000 - 170,000
Lead AI Infrastructure Architect for Large-Scale GPU Clusters
Lead AI Infrastructure Architect for Large-Scale GPU Clusters

NVIDIA • Santa Clara (CA)

On-site
USD 184,000 - 356,500
Equity and benefits
Senior AI Compute Infra Engineer (Hybrid)
Senior AI Compute Infra Engineer (Hybrid)

Arm Limited • Seattle (WA)

Hybrid
USD 209,000 - 283,000
Relocation package
Recruitment accommodations
Senior AI/ML Infra Architect — Multi-Cloud & Burstable GPU
Senior AI/ML Infra Architect — Multi-Cloud & Burstable GPU

Deepgram • United States

Remote
USD 120,000 - 150,000
Medical, dental, vision benefits
Unlimited PTO
401(k) plan with company match
+1