Senior AI Infrastructure Architect (GPU & Serving)

Makers Fund

Palo Alto (CA)

On-site

USD 180,000 - 240,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Equity
Health benefits
Monthly stipends
Company retreats

Job summary

Makers Fund is seeking a senior engineer to lead the design and implementation of scalable GPU infrastructure and high-performance AI model serving APIs. You will architect distributed systems to optimize AI workloads and mentor engineers to set the technical vision for AI infrastructure.

The role requires 5+ years in systems infrastructure with deep Kubernetes, cloud platforms, and AI serving frameworks, and proficiency in Python, Go, or C++. Experience managing large GPU fleets is essential.

Qualifications

  • 5+ years in systems infrastructure with Kubernetes, cloud platforms and AI serving frameworks.
  • Proficiency in Python, Go or C++ and experience managing large GPU fleets.

Responsibilities

  • Lead design and implementation of scalable GPU infrastructure and AI model serving APIs.
  • Architect robust distributed systems for optimized AI workloads.
  • Mentor engineers to set the technical vision for AI infrastructure.

Skills

GPU infrastructure
Distributed systems
Kubernetes
Cloud platforms
Python
Go
C++
AI model serving
MLOps
System architecture

Job description

Makers Fund is seeking a senior engineer to lead the design and implementation of scalable GPU infrastructure and high-performance AI model serving APIs. You will architect distributed systems to optimize AI workloads and mentor engineers to set the technical vision for AI infrastructure.

The role requires 5+ years in systems infrastructure with deep Kubernetes, cloud platforms, and AI serving frameworks, and proficiency in Python, Go, or C++. Experience managing large GPU fleets is essential.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Software Engineer, AI Infra
Software Engineer, AI Infra

Makers Fund • Palo Alto (CA)

On-site
USD 180,000 - 240,000
Equity
Health benefits
Monthly stipends
+1
Staff Software Engineer (AI Infrastructure)
Staff Software Engineer (AI Infrastructure)

DeepRec.ai • Palo Alto (CA)

On-site
USD 180,000 - 320,000
Senior AI Infrastructure Lead - GPU Clusters & Model Serving
Senior AI Infrastructure Lead - GPU Clusters & Model Serving

Outsourceit • San Francisco (CA)

On-site
USD 120,000 - 170,000
Senior AI Infrastructure Engineer — Scale GPU Clusters
Senior AI Infrastructure Engineer — Scale GPU Clusters

AI Breaking Wire • San Francisco (CA)

On-site
USD 280,000 - 400,000
Equity
Medical, dental, and vision benefits
Unlimited PTO
+2
Senior AI Infrastructure Engineer — Scale GPU Clusters Remote
Senior AI Infrastructure Engineer — Scale GPU Clusters Remote

AI Breaking Wire • San Francisco (CA), Northern (KY)

Hybrid
USD 280,000 - 420,000
Equity options
Health, vision, dental benefits
Unlimited PTO
+2
Senior AI Infrastructure Engineer | Scale GPU Clusters
Senior AI Infrastructure Engineer | Scale GPU Clusters

Fuel Talent LLC • Seattle (WA)

Hybrid
USD 126,000 - 189,000
AI Infrastructure Architect — Scalable GPU Compute
AI Infrastructure Architect — Scalable GPU Compute

EngineersOfAI • Sunnyvale (CA)

On-site
USD 150,000 - 200,000
Senior AI Infra Engineer: Large-Scale GPU & HPC
Senior AI Infra Engineer: Large-Scale GPU & HPC

Anduril Industries • Costa Mesa (CA)

On-site
USD 166,000 - 220,000
Equity grants
Benefits package
Senior GPU Infra Architect for Scalable AI Compute
Senior GPU Infra Architect for Scalable AI Compute

AI Chopping Block • Costa Mesa (CA), Northern (KY)

Hybrid
USD 166,000 - 220,000
Senior AI Infra Architect: Scalable GPU & Edge Platforms
Senior AI Infra Architect: Scalable GPU & Edge Platforms

Seekr • San Francisco (CA)

Hybrid
USD 190,000 - 260,000
Equity ownership – RSUs
Unlimited PTO
Flexible hybrid work environment
+3