Global Inference Engineer — End-to-End Deployment

Hyperbolic

San Francisco (CA)

On-site

USD 150,000 - 190,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Hyperbolic is seeking an Inference Engineer to build end-to-end inference capabilities on Forge and our Kubernetes stack. You will deploy models, evaluate frameworks, and establish production-ready monitoring, gateways, and endpoints across global clusters.

This role requires deep knowledge of distributed inference, Kubernetes production experience, and a practical mindset to optimize performance, autoscale workloads, and debug real traffic with our NeoCloud partners.

Qualifications

  • Strong general inference background with end-to-end understanding.
  • Deep Kubernetes experience in production clusters.
  • Knowledge of TTFT, disaggregated inference, speculative decoding, KV cache.
  • Familiarity with inference frameworks and serving engines.
  • Experience with NVIDIA Dynamo in distributed serving.
  • Experience setting up monitoring, gateways, endpoints for production inference.
  • Proven ability to take product from concept to live traffic.
  • Self-initiative to own an area with minimal direction.
  • Willingness to take on adjacent work as needed.

Responsibilities

  • Deploy models on Forge and Kubernetes offering.
  • Evaluate inference frameworks and stand up monitoring, gateways, and endpoints.
  • Optimize performance: autoscaling, KV-cache orchestration, and related tasks.
  • Debug production inference issues and address bottlenecks.
  • Own end-to-end inference product from inception to live traffic.

Skills

Inference expertise
Kubernetes
Inference frameworks
NVIDIA Dynamo
Monitoring & gateways
Production deployment
Distributed serving
Self-starting

Job description

Hyperbolic is seeking an Inference Engineer to build end-to-end inference capabilities on Forge and our Kubernetes stack. You will deploy models, evaluate frameworks, and establish production-ready monitoring, gateways, and endpoints across global clusters.

This role requires deep knowledge of distributed inference, Kubernetes production experience, and a practical mindset to optimize performance, autoscale workloads, and debug real traffic with our NeoCloud partners.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Inference Engineer, Global GPU Deployment & Kubernetes
Inference Engineer, Global GPU Deployment & Kubernetes

Hyperbolic • San Francisco (CA)

On-site
USD 140,000 - 230,000
Inference Engineer
Inference Engineer

Hyperbolic • San Francisco (CA)

On-site
USD 150,000 - 190,000
Member of Technical Staff - Inference
Member of Technical Staff - Inference

Hyperbolic • San Francisco (CA)

On-site
USD 140,000 - 230,000
Staff Infra Engineer – Global Inference & Kubernetes
Staff Infra Engineer – Global Inference & Kubernetes

Xpertise Recruitment • San Francisco (CA)

On-site
USD 350,000 - 450,000
Inference Lead
Inference Lead

Compunnel Inc. • Charlotte (NC)

On-site
USD 170,000 - 210,000
Staff & Senior Software Engineer, Cloud Inference
Staff & Senior Software Engineer, Cloud Inference

Anthropic Limited • San Francisco (CA)

Hybrid
USD 320,000 - 485,000
Competitive compensation
Equity donation matching
Generous vacation and parental leave
+2
Real-Time Inference Architect & Platform Lead
Real-Time Inference Architect & Platform Lead

Compunnel Inc. • Charlotte (NC)

Hybrid
USD 170,000 - 210,000
INFERENCE ENGINEER
INFERENCE ENGINEER

Makermaker • San Francisco (CA)

On-site
USD 120,000 - 160,000
Engineering Manager, Scalable Inference Platform
Engineering Manager, Scalable Inference Platform

Anthropic Limited • San Francisco (CA)

Hybrid
USD 405,000 - 625,000
Competitive compensation
Benefits
Equity donation matching
+4
Senior Inference Engineer, AI Infrastructure & Production
Senior Inference Engineer, AI Infrastructure & Production

Hamilton Barnes • United States

On-site
USD 225,000 - 275,000
Full Benefits