[Agentic AI] Senior Software Engineer, AI Memory Systems & Resource Management

Hewlett Packard Co.

Spring (TX)

On-site

USD 147,000 - 237,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Health insurance
Dental insurance
Vision insurance
Disability insurance
Parental leave
Holidays (11)
Flexible paid time off

Job summary

Hewlett Packard Co. is seeking a Senior Software Engineer to architect HP's Memory Management platform for AI workloads on client devices and cloud resources.

You will define policies for memory allocation, KV cache management, and QoS, balancing performance, memory use, and power with intelligent resource arbitration. The role demands deep OS and memory architecture expertise, experience with AI runtimes, and strong collaboration across hardware, firmware, and software teams.

Qualifications

  • Four-year or graduate degree in a technical field or equivalent experience.
  • 12+ years in OS, systems software, or AI infrastructure.
  • Experience delivering scalable platform technologies and runtimes.

Responsibilities

  • Define end-to-end architecture for HP's Memory Management platform.
  • Architect memory allocation, prioritization, and QoS across AI workloads.
  • Lead model residency management for large AI models.
  • Develop telemetry and analytics to monitor memory pressure and efficiency.
  • Collaborate with OS, silicon, and framework teams across HP.

Skills

C++
Python
Memory management
Performance tuning
Telemetry platforms
Distributed systems
AI runtimes

Education

Bachelor's degree or higher in CS/CE/EE

Tools

ONNX Runtime
TensorRT
CUDA
OpenVINO

Job description

## [Agentic AI] Senior Software Engineer, AI Memory Systems & Resource ManagementApply: Spring, Texas, United States of America: Austin, Texas, United States of America: Full time: Posted Yesterday: 3168347[Agentic AI] Senior Software Engineer, AI Memory Systems & Resource Management**Description -****Senior Software Engineer – AI Memory Systems & Resource Management****Job Summary**The Commercial Systems Software Engineering organization is developing HP's **Memory Management** platform, a foundational component of the Agentic AI Software Stack designed to optimize memory utilization, model execution, and resource orchestration for next-generation AI PCs.The Senior Software Engineer will define the architecture and technical strategy for AI memory management across heterogeneous compute environments, including CPUs, GPUs, NPUs, storage, and cloud resources. The role will focus on enabling efficient execution of large language models, multi-agent workloads, multimodal AI applications, and enterprise AI scenarios through intelligent memory allocation, model residency management, KV cache optimization, workload prioritization, and Quality of Service (QoS) controls.This position requires deep expertise in operating systems, memory architectures, AI runtime systems, workload scheduling, performance optimization, and large-scale software architecture. The architect will work closely with silicon vendors, operating system partners, AI framework teams, and product organizations to develop innovative technologies that maximize AI performance while maintaining system responsiveness, security, and power efficiency.**Responsibilities*** Define and drive the end-to-end architecture for HP's Memory Management platform.* Architect systems for intelligent memory allocation, prioritization, and optimization across AI workloads running on client devices.* Lead design of model residency management capabilities to enable efficient deployment and execution of large AI models on resource-constrained systems.* Define policies for KV cache management, context window optimization, model sharing, and memory multiplexing across multiple AI agents.* Develop policy engines that dynamically balance performance, memory consumption, power usage, and user responsiveness.* Architect workload QoS and resource arbitration mechanisms across CPU, GPU, NPU, memory, storage, and network resources.* Define strategies for local, hybrid, and cloud model execution based on system state, workload requirements, and resource availability.* Lead development of telemetry and analytics systems that monitor memory pressure, model utilization, resource contention, and workload efficiency.* Partner with operating system, firmware, silicon, and AI framework teams to optimize memory behavior across the full platform stack.* Establish technical roadmaps, engineering standards, and architectural guidance across multiple software teams.* Mentor senior engineers and architects while influencing company-wide AI platform strategy.* Engage with ecosystem partners including Microsoft, Intel, AMD, Qualcomm, NVIDIA, and ISVs to align memory optimization technologies and industry standards.**Education & Experience Recommended*** Four-year or Graduate Degree in Computer Science, Computer Engineering, Electrical Engineering, Software Engineering, or related technical field, or equivalent experience.* Typically 12+ years of industry experience in operating systems, systems software, platform architecture, AI infrastructure, memory management, or performance engineering.* Proven track record delivering scalable platform technologies, runtime systems, or enterprise software architectures.* Experience building software that operates close to hardware and operating system layers.**Core Technical Expertise****Memory Systems Architecture*** Deep expertise in operating system memory management concepts including virtual memory, paging, allocation strategies, memory pressure management, caching, NUMA architectures, and resource isolation.* Advanced understanding of DRAM architectures, memory controllers, UMA designs, storage hierarchies, and memory subsystems.* Experience optimizing memory behavior for high-performance applications and distributed systems.**AI Memory Optimization*** Expertise in AI model memory management including: + Model residency management + Memory budgeting + Model quantization + Dynamic model loading and unloading + Context window optimization + Hybrid local/cloud model execution* Experience reducing AI memory footprints while maintaining model accuracy and performance.**LLM Runtime Systems*** Strong knowledge of: + KV cache optimization + Context management + Token generation pipelines + Model serving architectures + Multi-model execution frameworks + Agentic AI runtimes* Experience supporting concurrent AI agents sharing compute and memory resources.**Resource Governance & Scheduling*** Expertise in workload scheduling, admission control, resource allocation, and QoS management.* Experience coordinating workloads across heterogeneous compute engines including CPU, GPU, NPU, and cloud services.* Understanding of power-aware and thermal-aware resource management techniques.**Performance Engineering*** Expert-level understanding of performance profiling, bottleneck analysis, workload characterization, and observability systems.* Experience building telemetry platforms that generate insights from large-scale performance data.* Ability to model and predict system behavior under varying workload conditions.**AI Infrastructure & Platform Skills*** Experience with AI runtimes such as ONNX Runtime, OpenVINO, DirectML, TensorRT, CUDA, ROCm, Qualcomm AI SDKs, or equivalent technologies.* Experience optimizing AI inferencing pipelines on client computing platforms.* Familiarity with model compression techniques including quantization, pruning, distillation, and low-rank adaptation methods.* Knowledge of agentic AI frameworks and orchestration systems.**Programming & Development Skills*** Expert proficiency in C++ and Python.* Strong systems programming experience.* Experience developing operating system services, runtime systems, middleware, or platform software.* Familiarity with Windows internals and client platform architecture.* Experience building large-scale analytics, telemetry, and automation solutions.**Leadership & Collaboration Skills*** Demonstrated technical leadership driving highly complex platform initiatives.* Ability to align diverse engineering organizations behind a common architectural vision.* Strong cross-functional collaboration skills spanning hardware, software, firmware, product, and partner organizations.* Exceptional communication skills with the ability to influence senior leadership and external partners.* Proven mentoring and talent development experience.**Preferred Qualifications*** Experience working on operating systems, memory managers, hypervisors, container runtimes, or distributed resource management systems.* Prior work on AI PCs, edge AI systems, client computing platforms, or performance-critical infrastructure.* Contributions to memory optimization, AI infrastructure, operating systems, or runtime technologies through patents, publications, or open-source projects.**Impact & Scope**This role will define how future HP AI PCs efficiently execute increasingly large and complex AI workloads. The architect will establish the foundational technologies that enable multi-agent systems, local AI inferencing, context persistence, and intelligent resource sharing while ensuring responsive user experiences. The work directly influences HP's AI PC differentiation strategy, ecosystem partnerships, and long-term software platform roadmap.**Complexity**Provides company-wide architectural leadership for one of the most technically challenging areas of the Agentic AI Software Stack. Solves highly complex problems involving memory management, AI model execution, workload orchestration, heterogeneous computing, operating systems, and performance optimization across hardware and software boundaries. The role is expected to create industry-leading innovations in AI memory efficiency and resource governance that become core differentiators for HP AI PCs. The pay range for this role is **$147,050.00** to **$237,150.00** USD annually with additionalopportunities for pay in the form of bonus and/or equity (applies to UnitedStates of America candidates only). Pay varies by work location, job-relatedknowledge, skills, and experience.Benefits:HP offers a comprehensive benefits package for this position, including:\\* Health insurance\\* Dental insurance\\* Vision insurance\\* Long term/short term disability insurance\\* Employee assistance program\\* Flexible spending account\\* Life insurance\\* Generous time off policies, including;\\* 4-12 weeks fully paid parental leave based on tenure\\* 11 paid holidays\\* Additional flexible paid vacation and sick leave (US benefits overview[https://hpbenefits.ce.alight.com/])The compensation and benefits information is accurate as of the date of thisposting. The Company reserves the right to modify this information at any time,with or without notice, subject to applicable law.**Job -**Software**Schedule -**Full time**Shift -**No shift premium (United States of America)**Travel -****Relocation -****Equal Opportunity Employer (EEO) -**HP, Inc. provides equal employment opportunity to all employees and prospective employees, without regard to race, color, religion, sex, national origin, ancestry, citizenship, sexual orientation, age, disability, or status as a protected veteran, marital status, familial status, physical or mental disability, medical condition, pregnancy, genetic predisposition or carrier status, uniformed service status, political affiliation or any other characteristic protected by applicable national, federal, state, and local law(s).Please be assured that you will not be subject to any adverse treatment if you choose to disclose the information requested. This information is provided voluntarily. The information obtained will be kept in strict confidence.For more information, review HP’s EEO Policy or read about your rights as an applicant under the law here: “Know Your Rights: Workplace Discrimination is Illegal\"
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

[Agentic AI] Senior Software Engineer, AI Memory Systems & Resource Management
[Agentic AI] Senior Software Engineer, AI Memory Systems & Resource Management

HP • Houston (TX)

On-site
USD 147,000 - 237,000
Health insurance
Dental insurance
Vision insurance
+7
[Agentic AI] Senior Agentic AI Systems Engineer – Runtime Frameworks & Resource Intelligence
[Agentic AI] Senior Agentic AI Systems Engineer – Runtime Frameworks & Resource Intelligence

Hewlett Packard Co. • Spring (TX)

On-site
USD 131,000 - 211,000
Health insurance
Dental insurance
Vision insurance
+8
[Agentic AI] Senior Software Engineer, AI Memory Systems & Resource Management
[Agentic AI] Senior Software Engineer, AI Memory Systems & Resource Management

HP • Austin (TX)

On-site
USD 147,000 - 237,000
Health insurance
Dental insurance
Vision insurance
+3
Director - Agentic AI Computing Foundation
Director - Agentic AI Computing Foundation

Hewlett Packard Co. • Spring (TX)

On-site
USD 183,000 - 320,000
Health insurance
Dental insurance
Vision insurance
+4
Vice President - PS Agentic AI PC Architecture & Development
Vice President - PS Agentic AI PC Architecture & Development

Hewlett Packard Co. • Palo Alto (CA)

On-site
USD 300,000 - 350,000
Health insurance
Dental insurance
Vision insurance
+8
AI Architect - Enterprise Products and Platform
AI Architect - Enterprise Products and Platform

Hewlett Packard Co. • Texas

On-site
USD 147,000 - 231,000
Health insurance
Dental insurance
Vision insurance
+6
Distinguished Technologist - AI Model Performance Architect
Distinguished Technologist - AI Model Performance Architect

Hewlett Packard Co. • Spring (TX)

Hybrid
USD 190,000 - 274,000
Health insurance
Dental insurance
Vision insurance
+2
[Agentic AI] Senior Agentic AI Systems Engineer – Runtime Frameworks & Resource Intelligence
[Agentic AI] Senior Agentic AI Systems Engineer – Runtime Frameworks & Resource Intelligence

HP • Austin (TX)

On-site
USD 131,000 - 211,000
Health insurance
Dental insurance
Vision insurance
+7
AI Software Ecosystem - AI Solution Architect and Consultant
AI Software Ecosystem - AI Solution Architect and Consultant

Hewlett Packard Co. • Spring (TX)

Hybrid
USD 130,700 - 205,200
Health insurance
Dental insurance
Vision insurance
+2
Director - Agentic AI Computing Foundation
Director - Agentic AI Computing Foundation

HP • Palo Alto (CA)

On-site
USD 183,000 - 320,000
Health insurance
Dental insurance
Vision insurance
+5