AI Infrastructure Architect — Scalable GPU Compute

EngineersOfAI

Sunnyvale (CA)

On-site

USD 150,000 - 200,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

EngineersOfAI in Sunnyvale, California is seeking an Architect for AI Infrastructure to design and evolve their foundational cloud compute systems. The successful candidate will focus on large-scale AI workloads across GPU clusters and multi-cloud environments.

With over 10 years of experience in distributed systems, the role requires strong technical leadership and mentorship skills. Ideal candidates will have a deep understanding of petabyte-scale data architecture, emphasizing rapid model deployment and operational excellence.

Qualifications

  • 10+ years designing and building large-scale distributed systems.
  • Experience enabling large-scale AI training and inference in GPU clusters.
  • Deep understanding of petabyte-scale data architecture.

Responsibilities

  • Define and evolve architecture for training and inference workloads.
  • Design systems for fast, reliable access to high-volume data.
  • Build foundations for large-scale AI workloads across cloud environments.
  • Act as a partner to leadership in aligning compute investments.
  • Uplift the engineering organization through mentorship.

Skills

Large-scale distributed systems design
GPU-based cloud infrastructure
Technical leadership
Mentorship

Education

Advanced degree in Computer Science, Electrical Engineering, or related field

Job description

EngineersOfAI in Sunnyvale, California is seeking an Architect for AI Infrastructure to design and evolve their foundational cloud compute systems. The successful candidate will focus on large-scale AI workloads across GPU clusters and multi-cloud environments.

With over 10 years of experience in distributed systems, the role requires strong technical leadership and mentorship skills. Ideal candidates will have a deep understanding of petabyte-scale data architecture, emphasizing rapid model deployment and operational excellence.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior AI Infrastructure Engineer — Scale GPU Clusters
Senior AI Infrastructure Engineer — Scale GPU Clusters

AI Breaking Wire • San Francisco (CA)

On-site
USD 280,000 - 400,000
Equity
Medical, dental, and vision benefits
Unlimited PTO
+2
AI Infrastructure Engineer - GPU & HPC Expert
AI Infrastructure Engineer - GPU & HPC Expert

Socket.dev • Town of Florida (NY)

On-site
USD 87,000 - 266,000
Senior AI Infrastructure Engineer — Scale GPU Clusters Remote
Senior AI Infrastructure Engineer — Scale GPU Clusters Remote

AI Breaking Wire • San Francisco (CA), Northern (KY)

Hybrid
USD 280,000 - 420,000
Equity options
Health, vision, dental benefits
Unlimited PTO
+2
Senior AI/ML Infra Architect — Multi-Cloud & Burstable GPU
Senior AI/ML Infra Architect — Multi-Cloud & Burstable GPU

Deepgram • United States

Remote
USD 120,000 - 150,000
Medical, dental, vision benefits
Unlimited PTO
401(k) plan with company match
+1
Senior AI Infrastructure Lead - GPU Clusters & Model Serving
Senior AI Infrastructure Lead - GPU Clusters & Model Serving

Outsourceit • San Francisco (CA)

On-site
USD 120,000 - 170,000
Lead AI Infrastructure Architect for Large-Scale GPU Clusters
Lead AI Infrastructure Architect for Large-Scale GPU Clusters

NVIDIA • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Equity and benefits
Senior AI Training Infra Engineer - Scale GPU Clusters
Senior AI Training Infra Engineer - Scale GPU Clusters

Designworks Talent • Bellevue (WA)

Hybrid
USD 180,000 - 240,000
Medical insurance
401(k) with company match
Paid holidays
Senior AI Infrastructure Architect — Enterprise GPU Clusters
Senior AI Infrastructure Architect — Enterprise GPU Clusters

NVIDIA • California (MO)

On-site
USD 184,000 - 288,000
Equity
Benefits
Senior AI Infrastructure Engineer - Global GPU Cloud Remote
Senior AI Infrastructure Engineer - Global GPU Cloud Remote

Togetherai • San Francisco (CA)

Hybrid
USD 160,000 - 230,000
Equity
Health insurance
Flexible remote work options
AI Infrastructure Solutions Architect - GPU Data Center
AI Infrastructure Solutions Architect - GPU Data Center

NVIDIA • Town of Texas (WI)

On-site
USD 184,000 - 357,000
Equity options
Benefits package