[Agentic AI] Systems Evaluation Engineer

HP; Austin (TX); On-site; USD 131,000 - 205,000; Full time

Benefits offered by this job

Health insurance

Dental insurance

Vision insurance

Paid parental leave

Disability insurance

Flexible spending account

Job summary

HP Inc. is seeking a senior engineer to define measurement methodologies and benchmarks quantifying customer outcomes, platform performance, and AI workload effectiveness.

You will guide design, development, installation, and maintenance of modern software solutions, working with stakeholders across departments to drive faster delivery. Responsibilities include metrics definition, benchmarking frameworks, and executive reporting, with a focus on scalable software engineering and performance

Qualifications

• Four-year or Graduate Degree in Computer Science, Statistics, Software Engineering, or related field or commensurate experience.
• Typically 7–10 years in software design, architecture, or related field.
• Strong analytical skills and benchmarking experience.

Responsibilities

• Define success metrics.
• Create benchmarking frameworks.
• Analyze customer outcomes.
• Produce executive performance reports.
• Contributes to technology strategy and roadmaps.
• Interacts with user management to promote productivity and satisfaction.
• Supervise external engineering vendors and provide feedback.

Skills

Analytical skills

Benchmarking

Linux

Windows validation

Agile method

SQL

C++

Python

DevOps

API

Education

Bachelors or higher in CS/Statistics/SE

Tools

AWS

Microsoft Azure

Docker

Kubernetes

React.js

Java

JavaScript

SQL

Job description

This role is responsible for defining measurement methodology and benchmarks to quantify customer outcomes, platform performance, and AI workload effectiveness ensuring the technical design, development, installation, and maintenance of state-of-the‑art software applications and services for our products. The role plays a crucial role in building technical solutions to help other developers/engineers deliver faster with modern software and application development tools. The role builds & maintains relationships with stakeholders across different departments and provide guidance & coaching to reportees in executing their tasks/responsibilities.

• Houston in-office requirement: 4-days

Description

This role is responsible for defining measurement methodology and benchmarks to quantify customer outcomes, platform performance, and AI workload effectiveness ensuring the technical design, development, installation, and maintenance of state-of-the‑art software applications and services for our products. The role plays a crucial role in building technical solutions to help other developers/engineers deliver faster with modern software and application development tools. The role builds & maintains relationships with stakeholders across different departments and provide guidance & coaching to reportees in executing their tasks/responsibilities.

• Houston in-office requirement: 4-days

Responsibilities

• Define success metrics.
• Create benchmarking frameworks.
• Analyze customer outcomes.
• Produce executive performance reports.
• Contributes to technology strategy and engineering roadmaps around software engineering; executes strategic software engineering proof of concepts.
• Interacts with user management regarding project status and user requirements to promote an environment with improved productivity and satisfaction.
• Supervises the work of external engineering vendors, analyzing the testing performed by vendors, and provides feedback and expertise to technicians.
• Identifies, recommends and implements changes to enhance effectiveness of engineering, implementation and service strategies

Education & Experience Recommended

• Four-year or Graduate Degree in Computer Science, Statistics, Software Engineering, or any other related discipline or commensurate work experience or demonstrated competence.
• Typically has 7-10 years of work experience, preferably in software designing & development, software architecture, programming languages, or a related field.
• Strong analytical skills
• Experience with benchmarking methodologies

Preferred Qualifications

• AI systems evaluation.
• Telemetry analytics
• Performance benchmarking.
• Linux and Windows validation experience

Preferred Certifications

• Programming Language/s Certification (Java, C++, Python, JavaScript, or similar)

Knowledge & Skills

• Agile Methodology
• Amazon Web Services
• Application Programming Interface (API)
• Automation
• C++
• Computer Science
• DevOps
• Docker (Software)
• Full Stack Development
• Java (Programming Language)
• JavaScript (Programming Language)
• Kubernetes
• Microservices
• Microsoft Azure
• Python (Programming Language)
• React.js
• Scalability
• Software Development
• Software Engineering
• SQL (Programming Language)

The pay range for this role is $130,700 to $205,200 USD annually with additional opportunities for pay in the form of bonus and/or equity (applies to United States of America candidates only). Pay varies by work location, job-related knowledge, skills, and experience.

Benefits

• Health insurance
• Dental insurance
• Vision insurance
• Long term/short term disability insurance
• Employee assistance program
• Flexible spending account
• Life insurance
• Generous time off policies, including;
• 4-12 weeks fully paid parental leave based on tenure
• 11 paid holidays
• Additional flexible paid vacation and sick leave (US benefits overview)

The compensation and benefits information is accurate as of the date of this posting. The Company reserves the right to modify this information at any time, with or without notice, subject to applicable law.

Job

Software

Schedule

Full time

Shift

No shift premium (United States of America)

Travel

25%

Equal Opportunity Employer (EEO)

HP, Inc. provides equal employment opportunity to all employees and prospective employees, without regard to race, color, religion, sex, national origin, ancestry, citizenship, sexual orientation, age, disability, or status as a protected veteran, marital status, familial status, physical or mental disability, medical condition, pregnancy, genetic predisposition or carrier status, uniformed service status, political affiliation or any other characteristic protected by applicable national, federal, state, and local law(s). Please be assured that you will not be subject to any adverse treatment if you choose to disclose the information requested. This information is provided voluntarily. The information obtained will be kept in strict confidence. For more information, review HP’s EEO Policy or read about your rights as an applicant under the law here: "Know Your Rights: Workplace Discrimination is Illegal"