AI Inference Platform Engineer

Hoonify Technologies Inc.; Albuquerque (NM); On-site; USD 120,000 - 190,000; Full time

Job summary

Hoonify Technologies Inc. seeks an AI Infrastructure Engineer to build, deploy, and operate the LLM serving infrastructure of our AI/ML platform. You will optimize production inference systems, tune runtimes, and scale across NVIDIA and AMD GPUs.

You will work with senior engineers, ship well-tested changes, and grow expertise in GPU-backed workloads, observability, and continuous delivery, with opportunities for broader ownership as you prove your impact.

Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, Applied Math, or Data Science.
• 3 years of relevant work experience or equivalent combination of education and relevant experience.
• Professional software engineering experience touching ML systems, GPU workloads, or high-performance backend services.
• Working knowledge of Kubernetes in production contexts, including writing and debugging manifests.
• Hands-on experience serving or deploying LLMs (vLLM, SGLang, TensorRT-LLM, or similar).

Responsibilities

• Deploy, tune, and optimize high-performance LLM inference pipelines on GPU infrastructure.
• Analyze, profile, and optimize model serving workloads across frameworks and hardware.
• Build and operate scalable, production-grade API services for model inference.
• Develop benchmarking harnesses, monitoring infrastructure, and automation tooling.
• Scale inference workloads across multi-GPU, multi-node environments.
• Collaborate with engineering and product teams to align infrastructure with services.
• Write runbooks, design notes, and documentation for changes.
• Participate in code/design reviews and incorporate feedback from seniors.

Skills

Kubernetes

Python

Linux

ML systems

CI/CD

Git workflows

LLM deployments

Go/Rust/C++

Education

Bachelor's degree in CS/CE/Applied Math/Data Science

Tools

vLLM

SGLang

TensorRT-LLM

Git

Grafana

Job description

Hoonify Technologies Inc. seeks an AI Infrastructure Engineer to build, deploy, and operate the LLM serving infrastructure of our AI/ML platform. You will optimize production inference systems, tune runtimes, and scale across NVIDIA and AMD GPUs.

You will work with senior engineers, ship well-tested changes, and grow expertise in GPU-backed workloads, observability, and continuous delivery, with opportunities for broader ownership as you prove your impact.