[Agentic AI] AI Runtime / ML Model Systems Engineer

HP; Houston (TX); Hybrid; USD 131,000 - 205,000; Full time

Benefits offered by this job

Health insurance

Dental insurance

Vision insurance

Disability insurance

Employee assistance program

Flexible spending account

Life insurance

Generous paid time off and parental-le

Job summary

HP is seeking an AI Runtime / ML Model Systems Engineer in Houston to design runtime abstractions and intelligent model placement across heterogeneous compute resources.

You will develop software for deployment, optimization of inference, and collaboration with vendors to meet security goals. This role requires strong AI runtime expertise and hands-on systems engineering experience.

Qualifications

• Four-year or graduate degree in Computer Science, Information Technology, Software Engineering, or related field.
• Typically 7–10 years of work experience in software design, architecture, and programming.
• Strong AI runtime expertise and experience optimizing inference execution.

Responsibilities

• Build runtime abstraction frameworks.
• Implement model placement policies.
• Develop xPU routing logic.
• Optimize inference execution.
• Lead software projects aligned with business and security strategies.
• Automate deployment of software and establish standards.
• Design solutions that protect and manage software and data.
• Contribute to engineering roadmaps and perform proof-of-concept work.
• Supervise external vendors and provide feedback to technicians.

Skills

Agile Methodology

AWS

APIs

Automation

C++

DevOps

Docker

Kubernetes

Python

React.js

SQL

Machine Learning

Education

Bachelors or Graduate degree in CS/IT/SE

Tools

ONNX

TensorRT

OpenVINO

NPU/GPU scheduling

Job description

AI Runtime / ML Model Systems Engineer

AI Runtime / ML Model Systems Engineer Description - This role is responsible for developing runtime abstraction layers and intelligent model placement systems across heterogeneous compute resources.. In this role, you will ensure the technical design, development, installation, and maintenance of state-of-the‑art software applications and services for the company. The role plays a crucial role in building technical solutions to help other developers/engineers deliver faster with modern software and application development tools. Houston in-office requirement: 4 days

Responsibilities

• Build runtime abstraction frameworks.
• Implement model placement policies.
• Develop xPU routing logic.
• Optimize inference execution.
• Leads the building of various software development projects and platforms while aligning them with business and security strategies and requirements.
• Builds standards, designs, and automates the deployment of software.
• Designs and develops solutions that protect and manage software products and data.
• Contributes to technology strategy and engineering roadmaps around software engineering; executes strategic software engineering proof of concepts.
• Supervises the work of external engineering vendors, analyzing the testing performed by vendors, and provides feedback and expertise to technicians.

Education & Experience Recommended

• Four-year or Graduate Degree in Computer Science, Information Technology, Software Engineering, or any other related discipline or commensurate work experience or demonstrated competence.
• Typically has 7-10 years of work experience, preferably in software designing & development, software architecture, programming languages, or a related field.
• Strong AI runtime expertise.
• Optimize inference execution.

Required Qualifications

• ONNX, TensorRT, OpenVINO.
• NPU/GPU scheduling.
• Edge AI deployment.

Knowledge & Skills

• Agile Methodology
• Amazon Web Services
• Application Programming Interface (API)
• Automation
• C++
• Computer Science
• DevOps
• Docker (Software)
• Full Stack Development
• Java (Programming Language)
• JavaScript (Programming Language)
• Kubernetes
• Microservices
• Microsoft Azure
• Python (Programming Language)
• React.js
• Scalability
• Software Development
• Software Engineering
• SQL (Programming Language)

Compensation & Benefits

The pay range for this role is $130,700 to $205,200 USD annually with additional opportunities for pay in the form of bonus and/or equity (applies to United States of America candidates only). Pay varies by work location, job-related knowledge, skills, and experience.

Benefits

• Health insurance
• Dental insurance
• Vision insurance
• Long term/short term disability insurance
• Employee assistance program
• Flexible spending account
• Life insurance
• Generous time off policies, including; 4-12 weeks fully paid parental leave based on tenure 11 paid holidays Additional flexible paid vacation and sick leave (US benefits overview)

Job Details

Job - Software Schedule - Full time Shift - No shift premium (United States of America) Travel - 25% Relocation - Equal Opportunity Employer (EEO) - HP, Inc.

Equal Opportunity Employer

HP, Inc. provides equal employment opportunity to all employees and prospective employees, without regard to race, color, religion, sex, national origin, ancestry, citizenship, sexual orientation, age, disability, or status as a protected veteran, marital status, familial status, physical or mental disability, medical condition, pregnancy, genetic predisposition or carrier status, uniformed service status, political affiliation or any other characteristic protected by applicable national, federal, state, and local law(s).

Additional Statements

Please be assured that you will not be subject to any adverse treatment if you choose to disclose the information requested.

The information obtained will be kept in strict confidence.

For more information, review HP’s EEO Policy or read about your rights as an applicant under the law here: “Know Your Rights: Workplace Discrimination is Illegal"

You want to reshape the way the world works. So do we. You’re looking for more than just a job; you’re looking to make a difference. That means creating something new. Something that matters. Something that changes how the world works for the better. A career at HP can help you build the tomorrow you want. Let’s grow together.

Privacy, Terms of Use, and Accessibility

Our founders believed that business exists when people work together to ‘accomplish something collectively which they could not accomplish separately.’ We uphold a zero‑tolerance policy towards discrimination and treat everyone with respect. By maintaining these principles, we empower the HP team to contribute to our collective success and the future of work.

Learn more about HP personal data practices at Privacy Statement, Personal Data Rights Notice (where applicable), Accessibility at HP, and Terms.

You can be yourself at HP. Learn more.