Senior LLM Inference Engineer (Hybrid)

Hobbsnews; Spring, Northern (TX, KY); Hybrid; USD 137,000 - 315,000; Full time

Job summary

Hewlett Packard Enterprise (HPE) is seeking a Senior Software Engineer for the Private Cloud AI organization to build and evolve the model runtime within the AI Essentials platform. You will design and implement core runtime components, optimize latency, and collaborate with inference teams on scaling workloads.

The role requires 8+ years in software engineering, 1–2+ years in LLM inference, and strong Go/Python, Kubernetes, and GPU expertise.

Qualifications

• Minimum 8 years of software engineering experience.
• 1–2+ years directly on LLM inference runtimes or production model serving.
• Degree in Computer Science or related field.

Responsibilities

• Design and own major components of the LLM serving deployment.
• Improve time-to-first-token, inter-token latency, and throughput per GPU.
• Build and operate distributed execution across GPU memory and host memory.

Skills

Go

Python

Kubernetes

GPU compute

Profiling/Debugging

Go/C++/CUDA reading

Education

Bachelor's degree in Computer Science or related field

Tools

Nsight

NVIDIA NIM

NCCL

KServe

Job description

Hewlett Packard Enterprise (HPE) is seeking a Senior Software Engineer for the Private Cloud AI organization to build and evolve the model runtime within the AI Essentials platform. You will design and implement core runtime components, optimize latency, and collaborate with inference teams on scaling workloads.

The role requires 8+ years in software engineering, 1–2+ years in LLM inference, and strong Go/Python, Kubernetes, and GPU expertise.