Staff Infra Engineer - Global GPU ML Inference

The Token Company

San Francisco (CA)

On-site

USD 120,000 - 160,000

Full time

14 days+
Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Equity
Housing
Food
Laundry and cleaning in SF
Visa sponsorship

Job summary

The Token Company in San Francisco is seeking a Member of Technical Staff for their infrastructure team. In this role, you will own the cloud systems that serve our compression API and build global low-latency, high-throughput GPU ML inference infrastructure.

The ideal candidate will have solid experience in cloud infrastructure, including AWS and Docker, and a proven track record in building production environments. Additional benefits include equity, housing, food, and visa sponsorship.

Qualifications

  • Strong in cloud infrastructure with experience in AWS, Terraform, Docker, and CI/CD.
  • Experience in building and operating production infrastructure.
  • A quick learner able to adapt to new solutions and technologies.

Responsibilities

  • Own the cloud systems that serve our compression API end-to-end.
  • Build global low-latency, high-throughput GPU ML inference infrastructure.
  • Constantly improve and research the best technologies.

Skills

AWS
Terraform
Docker
CI/CD
Performance and reliability at scale

Job description

The Token Company in San Francisco is seeking a Member of Technical Staff for their infrastructure team. In this role, you will own the cloud systems that serve our compression API and build global low-latency, high-throughput GPU ML inference infrastructure.

The ideal candidate will have solid experience in cloud infrastructure, including AWS and Docker, and a proven track record in building production environments. Additional benefits include equity, housing, food, and visa sponsorship.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Member of Technical Staff, Infrastructure
Member of Technical Staff, Infrastructure

The Token Company • San Francisco (CA)

On-site
USD 120,000 - 160,000
Equity
Housing
Food
+2
Staff Infra Engineer – Large-Scale GPU Training
Staff Infra Engineer – Large-Scale GPU Training

Hark • San Jose (CA)

On-site
USD 180,000 - 450,000
Senior GPU ML Infra Engineer — Mid-Training & Inference
Senior GPU ML Infra Engineer — Mid-Training & Inference

Reflection AI • San Francisco (CA)

On-site
USD 120,000 - 160,000
Staff Engineer, GPU AI Inference & RL Infrastructure
Staff Engineer, GPU AI Inference & RL Infrastructure

B Capital • San Francisco (CA)

On-site
USD 120,000 - 160,000
Top-tier compensation
Comprehensive medical, dental, and vision insurance
Fully paid parental leave
+2
Senior ML Infra Architect — Large-Scale GPU Training
Senior ML Infra Architect — Large-Scale GPU Training

Hark, Inc. • San Jose (CA)

On-site
USD 180,000 - 450,000
Cloud-Scale Backend Engineer for ML Inference
Cloud-Scale Backend Engineer for ML Inference

Praxis, Inc. • San Francisco (CA)

On-site
USD 170,000 - 250,000
Staff GPU Infra Engineer: Terraform, K8s & Large-Scale AI
Staff GPU Infra Engineer: Terraform, K8s & Large-Scale AI

Magic AI, Inc • San Francisco (CA)

On-site
USD 200,000 - 550,000
Equity
401(k) with 6% match
Health, dental and vision insurance
+3
Senior ML Infrastructure Engineer - GPU Training & MLOps
Senior ML Infrastructure Engineer - GPU Training & MLOps

Atoms • San Francisco (CA)

On-site
USD 224,000 - 280,000
Medical, Dental, Vision, Disability, and Life Insurance
Flexible Spending Account / Health Savings Account Options
401(k)
+2
AI Infra Engineer — GPU Cloud, Kubernetes/Slurm
AI Infra Engineer — GPU Cloud, Kubernetes/Slurm

Blue Signal Search • San Francisco (CA)

On-site
USD 180,000 - 240,000
Annual bonus
Equity participation
Comprehensive benefits
+1
Staff ML Engineer — Post-Training & RL Pipelines
Staff ML Engineer — Post-Training & RL Pipelines

SF Tensor • San Francisco (CA)

On-site
USD 275,000 - 315,000
Relocation assistance
Equity