Staff Infra Engineer - Global GPU ML Inference

The Token Company

San Francisco (CA)

On-site

USD 120,000 - 160,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity
Housing
Food
Laundry and cleaning in SF
Visa sponsorship

Job summary

The Token Company in San Francisco is seeking a Member of Technical Staff for their infrastructure team. In this role, you will own the cloud systems that serve our compression API and build global low-latency, high-throughput GPU ML inference infrastructure.

The ideal candidate will have solid experience in cloud infrastructure, including AWS and Docker, and a proven track record in building production environments. Additional benefits include equity, housing, food, and visa sponsorship.

Qualifications

  • Strong in cloud infrastructure with experience in AWS, Terraform, Docker, and CI/CD.
  • Experience in building and operating production infrastructure.
  • A quick learner able to adapt to new solutions and technologies.

Responsibilities

  • Own the cloud systems that serve our compression API end-to-end.
  • Build global low-latency, high-throughput GPU ML inference infrastructure.
  • Constantly improve and research the best technologies.

Skills

AWS
Terraform
Docker
CI/CD
Performance and reliability at scale

Job description

The Token Company in San Francisco is seeking a Member of Technical Staff for their infrastructure team. In this role, you will own the cloud systems that serve our compression API and build global low-latency, high-throughput GPU ML inference infrastructure.

The ideal candidate will have solid experience in cloud infrastructure, including AWS and Docker, and a proven track record in building production environments. Additional benefits include equity, housing, food, and visa sponsorship.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ML Infrastructure Engineer — On-Site SF, GPU Pipelines
ML Infrastructure Engineer — On-Site SF, GPU Pipelines

Objective Partners • San Francisco (CA)

On-site
USD 180,000 - 250,000
Full medical, dental, vision coverage
Flexible PTO
Daily catered lunches
+1
Staff Infra Engineer – LLM Inference
Staff Infra Engineer – LLM Inference

Morgan Pinnacle Group • San Francisco (CA)

On-site
USD 350,000 - 450,000
ML Systems Engineer - Accelerate GPU Training (Equity)
ML Systems Engineer - Accelerate GPU Training (Equity)

Digital Waffle • Menlo Park (CA)

On-site
USD 350,000 - 550,000
Equity
Staff ML Systems Engineer - GPU & Distributed Training
Staff ML Systems Engineer - GPU & Distributed Training

true-talent-solutions-partners • Menlo Park (CA)

On-site
USD 180,000 - 230,000
Cloud-Scale Backend Engineer for ML Inference
Cloud-Scale Backend Engineer for ML Inference

Praxis, Inc. • San Francisco (CA)

On-site
USD 170,000 - 250,000
AI Infra Engineer — GPU Cloud, Kubernetes/Slurm
AI Infra Engineer — GPU Cloud, Kubernetes/Slurm

Blue Signal Search • San Francisco (CA)

On-site
USD 180,000 - 240,000
Annual bonus
Equity participation
Comprehensive benefits
+1
Staff Engineer - Customer-Facing AI Inference Infra
Staff Engineer - Customer-Facing AI Inference Infra

Simplify • San Francisco (CA)

On-site
USD 200,000 - 300,000
Housing stipend
Uber/Waymo rides
Senior GPU Compiler Engineer — End-to-End MLIR & CUDA
Senior GPU Compiler Engineer — End-to-End MLIR & CUDA

San Francisco Tensor Company • San Francisco (CA)

On-site
USD 285,000 - 315,000
Relocation assistance
Office in San Francisco
Software Engineer, AI Infrastructure
Software Engineer, AI Infrastructure

Harell Data • Palo Alto (CA)

On-site
USD 180,000 - 260,000
Member of Technical Staff, ML Systems
Member of Technical Staff, ML Systems

true-talent-solutions-partners • Menlo Park (CA)

On-site
USD 180,000 - 230,000