AI Infrastructure Engineer: GPU ML Inference & Scale

Next Frontier Capital

Albuquerque (NM)

On-site

USD 130,000 - 210,000

Full time

14 days+
Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Hoonify is seeking an AI Infrastructure Engineer to design, build, and operate production-grade LLM inference infrastructure. You will optimize GPU-backed workloads, implement robust services, and collaborate with senior engineers to deliver scalable, observable systems.

You will work on multi-GPU, multi-node deployments, profiling across vLLM, SGLang, and TensorRT-LLM, and contribute to runbooks and design notes for the team.

Qualifications

  • Bachelor’s degree in CS/CE/Applied Math/Data Science or equivalent.
  • 3+ years of relevant software engineering experience.
  • Experience with ML systems, GPU workloads, or high-performance backend services.

Responsibilities

  • Deploy, tune, and optimize high-performance LLM inference pipelines on GPU infra.
  • Profile and optimize model serving workloads across frameworks and hardware.
  • Build scalable production API services for model inference with observability.
  • Develop benchmarking, monitoring, and automation tooling for measurable performance.
  • Scale workloads across multi-GPU, multi-node clusters.
  • Collaborate with engineering and product teams to align infra capabilities with services.
  • Write runbooks and design notes; participate in reviews.

Skills

Kubernetes
Python
LLMs
Linux
CI/CD
Go/Rust/C++

Education

Bachelor’s degree in CS/CE/Applied Math/Data Science

Tools

vLLM
SGLang
TensorRT-LLM
Git
CI/CD Pipelines

Job description

Hoonify is seeking an AI Infrastructure Engineer to design, build, and operate production-grade LLM inference infrastructure. You will optimize GPU-backed workloads, implement robust services, and collaborate with senior engineers to deliver scalable, observable systems.

You will work on multi-GPU, multi-node deployments, profiling across vLLM, SGLang, and TensorRT-LLM, and contribute to runbooks and design notes for the team.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Inference Platform Engineer
AI Inference Platform Engineer

Hoonify Technologies Inc. • Albuquerque (NM)

On-site
USD 120,000 - 190,000
AI Infrastructure Engineer - Inference Platform
AI Infrastructure Engineer - Inference Platform

Hoonify Technologies Inc. • Albuquerque (NM)

On-site
USD 120,000 - 190,000
ML Inference Systems Engineer — Kubernetes & GPU Scale
ML Inference Systems Engineer — Kubernetes & GPU Scale

Luma AI • United States

Remote
USD 140,000 - 190,000
Remote AI Infrastructure Engineer — Scale ML & Inference
Remote AI Infrastructure Engineer — Scale ML & Inference

Vantaca, LLC • Redwood City (CA), Northern (KY)

Hybrid
USD 150,000 - 190,000
Medical, Dental, Vision
ML Platform Engineer: Scale AI & Inference
ML Platform Engineer: Scale AI & Inference

Apply • San Francisco (CA)

Hybrid
USD 245,000 - 345,000
Flexible Time Off
Health Insurance
Work From Home Allowance
+2
ML Infra Engineer — GPU Clusters & Distributed Systems
ML Infra Engineer — GPU Clusters & Distributed Systems

AI Breaking Wire • San Francisco (CA), Northern (KY)

Hybrid
USD 170,000 - 250,000
Industry-leading compensation and/or:?
Unlimited PTO
Top-tier medical, dental, and vision
+1
Hybrid AI HPC Infrastructure Engineer (GPU/ML)
Hybrid AI HPC Infrastructure Engineer (GPU/ML)

Analysis Group, Inc. • Boston (MA)

On-site
USD 150,000 - 170,000
Discretionary annual bonus
Benefits package
LLM Inference Engineer: Scale & Optimize Production
LLM Inference Engineer: Scale & Optimize Production

Comunidade Metodista • Palo Alto (CA)

On-site
USD 150,000 - 210,000
Senior DL Inference Engineer - GPU & LLM Performance
Senior DL Inference Engineer - GPU & LLM Performance

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Equity
Benefits
LLM Inference GPU Systems Consultant
LLM Inference GPU Systems Consultant

Delan Associates, Inc • Charlotte (NC)

On-site
USD 150,000 - 210,000