AI Runtime & ML Systems Engineer - Edge Inference Architect

HP; Spring (TX); On-site; USD 142,000 - 195,000; Full time

Benefits offered by this job

Health insurance

Dental insurance

Vision insurance

Disability insurance

Employee assistance program

Flexible spending account

Life insurance

Parental leave

Paid holidays

Job summary

HP seeks a senior software engineer to develop runtime abstraction layers and intelligent model placement across heterogeneous compute resources. You will ensure design, development, installation, and maintenance of advanced software solutions for developers and engineers.

The role requires strong AI runtime expertise, experience with ONNX/TensorRT/OpenVINO, and a track record in deploying edge AI solutions. Houston in-office 4 days per week with a comprehensive benefits package.

Qualifications

• Four-year or Graduate Degree in Computer Science, Information Technology, Software Engineering, or related discipline.
• Typically 7-10 years of work experience in software design/development, software architecture, programming languages, or related field.
• Strong AI runtime expertise.
• Optimize inference execution.

Responsibilities

• Build runtime abstraction frameworks.
• Implement model placement policies.
• Develop xPU routing logic.
• Optimize inference execution.
• Leads the building of software development projects and platforms aligned with business and security requirements.
• Builds standards and automates deployment of software.
• Designs and develops solutions that protect and manage software products and data.
• Contributes to technology strategy and engineering roadmaps; executes proof of concepts.
• Supervises external vendors and provides feedback to technicians.

Skills

C++

AI runtime

NPU/GPU scheduling

Edge AI deployment

APIs

DevOps

Python

Docker

Kubernetes

OpenVINO

ONNX

TensorRT

Education

Four-year or Graduate Degree in Computer Science or related discipline

7-10 years of work experience in software design/architecture

Tools

AWS

Microsoft Azure

APIs

Job description

HP seeks a senior software engineer to develop runtime abstraction layers and intelligent model placement across heterogeneous compute resources. You will ensure design, development, installation, and maintenance of advanced software solutions for developers and engineers.

The role requires strong AI runtime expertise, experience with ONNX/TensorRT/OpenVINO, and a track record in deploying edge AI solutions. Houston in-office 4 days per week with a comprehensive benefits package.