AI Infra Engineer — Production LLM Systems

Hewlett Packard Enterprise Company; Friday Harbor (WA); Hybrid; USD 120,000 - 160,000; Full time

Benefits offered by this job

Hybrid work model

Career development opportunities

Job summary

Hewlett Packard Enterprise invites a Senior AI Infra Engineer to join the NPAT Content Services AI Infrastructure team. The role is hybrid, requiring on-site presence about two days weekly at a HPE office, with responsibilities spanning end-to-end AI infrastructure for content generation, retrieval, QA, and deployment.

You will ideate, integrate, and productionize established LLMs via APIs or in-house tooling, ensuring reliable, scalable systems for training and documentation content across the

Qualifications

• 5+ years of software engineering, infrastructure, platform, or DevOps/SRE experience.
• Strong scripting/programming ability - Python, Java, etc.
• Experience with prompt management, retrieval-augmented generation, agentic tooling, skills, MCP, etc.
• Practical experience integrating third-party APIs into production systems (LLM APIs a strong plus).
• Experience with cloud infrastructure (AWS, GCP, or Azure) and infra-as-code practices.
• Hands-on experience with containers and container tooling.
• Comfortable operating in Linux and Windows server environments.
• Experience standing up and maintaining web services (APIs, web apps, backend services).
• Solid understanding of building reliable, observable, and cost-conscious backend systems.

Responsibilities

• Design, build, and operate infrastructure that integrates LLMs into internal tools and customer-facing products.
• Evaluate, implement, and maintain third-party AI tooling and platforms, owning the vendor relationship and integration where applicable.
• Build homegrown tooling (pipelines, orchestration layers, retrieval systems, evaluation harnesses, monitoring).
• Own the operational reliability of AI-powered systems: uptime, latency, cost, and observability.
• Implement guardrails around cost, rate limits, prompt/version management, and failure handling for LLM-backed services.
• Collaborate with documentation and training stakeholders to translate use cases into working, maintainable systems.
• Set up monitoring, logging, and telemetry to understand AI system performance in production.
• Contribute to internal standards and best practices for AI tooling adoption.
• Act as an AI evangelist within the org — sharing knowledge and demonstrating new capabilities.

Skills

Python

Java

LLM APIs

Cloud Infra

Containers

Linux/Windows

APIs

Tools

Kubernetes

Terraform

Job description

Hewlett Packard Enterprise invites a Senior AI Infra Engineer to join the NPAT Content Services AI Infrastructure team. The role is hybrid, requiring on-site presence about two days weekly at a HPE office, with responsibilities spanning end-to-end AI infrastructure for content generation, retrieval, QA, and deployment.

You will ideate, integrate, and productionize established LLMs via APIs or in-house tooling, ensuring reliable, scalable systems for training and documentation content across the