Infra & LLM Systems Engineer — Founding Team

Amadeus Search

San Francisco (CA)

Hybrid

USD 170,000 - 220,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

A leading technology firm in San Francisco is seeking a Member of Technical Staff – Infrastructure & LLMs. This role offers significant ownership in designing and developing high-performance systems for LLMs, focusing on distributed systems and multi-GPU workloads. The ideal candidate should have 2+ years of backend engineering experience and strong Python skills. This full-time position offers a hybrid work model and competitive compensation between $170,000 and $220,000, along with equity options.

Qualifications

  • 2+ years experience in backend or infrastructure engineering.
  • Deep interest or experience in distributed systems, GPU orchestration, or AI infra.
  • Strong technical curiosity demonstrated through side projects, OSS contributions, or community involvement.

Responsibilities

  • Own the design and development of performance-critical systems.
  • Scale multi-GPU inference workloads.
  • Design distributed job schedulers.

Skills

Backend engineering
Distributed systems
GPU orchestration
AI infrastructure
Python

Tools

Docker
CUDA
Kubernetes

Job description

A leading technology firm in San Francisco is seeking a Member of Technical Staff – Infrastructure & LLMs. This role offers significant ownership in designing and developing high-performance systems for LLMs, focusing on distributed systems and multi-GPU workloads. The ideal candidate should have 2+ years of backend engineering experience and strong Python skills. This full-time position offers a hybrid work model and competitive compensation between $170,000 and $220,000, along with equity options.
Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

AI Platform Engineer — LLM Infra, Security & Orchestration
AI Platform Engineer — LLM Infra, Security & Orchestration

Brain Co. • San Francisco (CA)

On-site
USD 120,000 - 160,000
Competitive salary plus equity
Daily lunches
Commuter benefits
+3
Member of the Technical Staff- LLMs
Member of the Technical Staff- LLMs

Amadeus Search • San Francisco (CA)

Hybrid
USD 170,000 - 220,000
ML Infra Engineer — Open-Source LLM Performance
ML Infra Engineer — Open-Source LLM Performance

well-funded deeptech startup • San Francisco (CA)

Hybrid
USD 250,000 - 500,000
Bonus
Medical
Dental
+4
LLM Training Infra Engineer - Distributed Systems
LLM Training Infra Engineer - Distributed Systems

ByteDance • San Jose (CA)

On-site
USD 244,000 - 450,000
Medical, dental, and vision insurance
401(k) savings plan with company match
Paid parental leave
+5
Founding ML Infra Engineer — Production-Grade LLMs
Founding ML Infra Engineer — Production-Grade LLMs

Realmlabs • Sunnyvale (CA)

On-site
USD 210,000 - 350,000
Market aligned compensation
Founding engineer equity
Medical, Dental, Vision, and Life insurance
+2
Staff Engineer - LLM Inference & Serving at Scale
Staff Engineer - LLM Inference & Serving at Scale

Prime Intellect • San Francisco (CA)

Hybrid
USD 150,000 - 300,000
LLM Inference Engineering Manager — Hybrid | Equity
LLM Inference Engineering Manager — Hybrid | Equity

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 287,500
Competitive salary
Equity options
Comprehensive benefits
Staff Engineer, LLM Inference & Infra
Staff Engineer, LLM Inference & Infra

Prime Intellect • United States

Hybrid
USD 120,000 - 150,000
Competitive compensation
Flexible work arrangement
Full visa sponsorship
+2
LLM Applications Engineer
LLM Applications Engineer

SupportFinity™ • New York (NY)

Hybrid
USD 130,000 - 175,000
LLM Applications Engineer: AI-First Platform & Equity
LLM Applications Engineer: AI-First Platform & Equity

Uncountable Inc. • San Francisco (CA), New York (NY)

Hybrid
USD 130,000 - 175,000
Competitive Salary and Equity
Health and Dental Insurance
401K with Employer Contribution