AI Runtime & ML Inference Systems Engineer

HP Inc.; Spring (TX); Hybrid; USD 131,000 - 205,000; Full time

Benefits offered by this job

Health insurance

Dental insurance

Vision insurance

Disability insurance

Employee assistance program

Flexible spending account

Life insurance

Parental leave (4–12 weeks)

Holidays

Job summary

HP, Inc. in Spring, TX is seeking an AI Runtime/ML Model Systems Engineer to develop runtime abstractions and intelligent model placement across heterogeneous compute resources.

You will design, install, and maintain modern software tools for developers and engineers, with a Houston in-office requirement of four days. Responsibilities include building runtime frameworks, model placement policies, and xPU routing logic, while optimizing inference execution and ensuring security alignment across

Qualifications

• Four-year or Graduate Degree in Computer Science, Information Technology, Software Engineering, or related discipline.
• Typically 7–10 years of experience in software design, architecture, or related field.
• Strong AI runtime expertise and experience with model deployment.
• Experience with ONNX, TensorRT, or OpenVINO is preferred.

Responsibilities

• Build runtime abstraction frameworks.
• Implement model placement policies.
• Develop xPU routing logic.
• Optimize inference execution.
• Leads the building of various software development projects and platforms while aligning with business and security strategies and requirements.
• Builds standards, designs, and automates the deployment of software.
• Designs and develops solutions that protect and manage software products and data.
• Contributes to technology strategy and engineering roadmaps around software engineering; executes strategic software engineering proof of concepts.
• Supervises the work of external engineering vendors, analyzing the testing performed by vendors, and provides feedback and expertise to technicians.

Skills

C++

Python

DevOps

AWS

Kubernetes

API

Software Architecture

SQL

Education

Four-year or Graduate Degree in Computer Science or related discipline

Tools

Docker

Kubernetes

AWS

Microsoft Azure

ONNX

TensorRT

OpenVINO

Job description

HP, Inc. in Spring, TX is seeking an AI Runtime/ML Model Systems Engineer to develop runtime abstractions and intelligent model placement across heterogeneous compute resources.

You will design, install, and maintain modern software tools for developers and engineers, with a Houston in-office requirement of four days. Responsibilities include building runtime frameworks, model placement policies, and xPU routing logic, while optimizing inference execution and ensuring security alignment across