Lead, Scale GPU Inference Infrastructure (Remote)

telnyx54

United States

Remote

USD 180,000 - 320,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Founding-seat influence on platform
Remote position
Open-source contribution & conference"

Job summary

telnyx54 is seeking an Inference Infrastructure Architect to operate and scale a globally expanding bare-metal GPU fleet powering production LLM serving. You will own the path from hardware and Kubernetes to an OpenAI-compatible inference endpoint, shaping architecture for multi-tenant serverless traffic and enterprise deployments.

The role requires deep expertise in vLLM/SGLang, Kubernetes on bare metal, performance engineering, and automation in Python and Go.

Qualifications

  • Must deploy, tune, and upgrade vLLM/SGLang at scale.
  • Hands-on Kubernetes on bare metal with GPU Operator and topology-aware scheduling.
  • Ability to read engine/DCGM metrics and size deployments.
  • Proficient in Python and Go for automation.
  • Communicate in English and Chinese with open-source communities.

Responsibilities

  • Operate and scale a global bare-metal GPU fleet.
  • Build serverless serving pools with vLLM, SGLang, and MoE.
  • Design fleet layer on Kubernetes Gateway API with advanced routing.
  • Stand up Kubernetes with GPU Operator, Ironic, and related components.
  • Manage elasticity with P2P distribution and autoscaling.
  • Wire observability with DCGM, Prometheus, and OpenTelemetry.

Skills

vLLM/SGLang expertise
Kubernetes on bare metal
Performance engineering
Python & Go automation
English & Chinese communication

Job description

telnyx54 is seeking an Inference Infrastructure Architect to operate and scale a globally expanding bare-metal GPU fleet powering production LLM serving. You will own the path from hardware and Kubernetes to an OpenAI-compatible inference endpoint, shaping architecture for multi-tenant serverless traffic and enterprise deployments.

The role requires deep expertise in vLLM/SGLang, Kubernetes on bare metal, performance engineering, and automation in Python and Go.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Inference Infrastructure Architect (Remote)
Inference Infrastructure Architect (Remote)

telnyx54 • United States

Remote
USD 180,000 - 320,000
Founding-seat influence on platform
Remote position
Open-source contribution & conference"
Tech Lead - AI Inference
Tech Lead - AI Inference

wekatest • United States

Remote
USD 180,000 - 240,000
Medical insurance
Dental insurance
Vision insurance
+5
Inference Systems Engineer for Scalable GPU ML (Remote)
Inference Systems Engineer for Scalable GPU ML (Remote)

Prime Intellect, Inc. • United States

Remote
USD 180,000 - 240,000
Equity incentives
Visa sponsorship
Relocation assistance
+1
GPU Compute Lead - Scale Inference Clusters & Power
GPU Compute Lead - Scale Inference Clusters & Power

Ample Industries (Formerly Vortx) • Santa Monica (CA)

On-site
USD 180,000 - 280,000
Tech Lead: LLM Inference & High-Performance Systems
Tech Lead: LLM Inference & High-Performance Systems

wekatest • United States

Remote
USD 180,000 - 240,000
Medical insurance
Dental insurance
Vision insurance
+5
Head of GPU Cloud
Head of GPU Cloud

Blue Signal LLC. • United States

On-site
USD 250,000 - 350,000
Lead Inference Engineer (Fully Remote)
Lead Inference Engineer (Fully Remote)

Aleroy • United States

Remote
USD 140,000 - 190,000
Senior ML Engineer — Inference & Optimization (Remote)
Senior ML Engineer — Inference & Optimization (Remote)

Cast AI • Miami (FL)

Remote
GBP 120,000 - 180,000
Equity options
Remote-friendly
Learning budget
+4
Senior GPU Compute Infra Engineer (Remote)
Senior GPU Compute Infra Engineer (Remote)

Boundless Network, Inc. • United States

Remote
USD 175,000 - 250,000
Equity allocation
Remote-first with off-sites
Flexible PTO
+2
Remote GPU Infra Engineer for Large-Scale Compute
Remote GPU Infra Engineer for Large-Scale Compute

lightningai • United States

Hybrid
USD 180,000 - 220,000
Discretionary bonus
Equity
Medical/dental/vision
+8