Distinguished Technologist, Edge AI Architect

HP

Spring (TX)

On-site

USD 174,000 - 278,000

Full time

40 hours ago
Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Health insurance
Dental insurance
Vision insurance
Disability insurance
Employee assistance program
Flexible spending account
Life insurance
Parental leave
Paid holidays
Flexible vacation

Job summary

HP is seeking a senior technical leader to own the full-stack Edge AI platform, spanning from silicon to model lifecycle governance. You will set the technical direction across hardware, OS/security, inference, runtimes, and model management, ensuring a cohesive, secure, and scalable system.

You will define cross-layer interfaces, lead architectural decisions, and drive engineering standards while collaborating with product, firmware, and security teams.

Qualifications

  • Four-year or graduate degree in CS/IT/Software Engineering or related discipline.
  • Typically 12+ years of work experience in software design & architecture.

Responsibilities

  • Own the multi-year technical roadmap and architectural vision for a full-stack Edge AI platform.
  • Define cross-layer architecture and interface contracts across hardware to model management.
  • Architect model management, registry, and lifecycle systems across a distributed fleet.
  • Set the architecture for agentic runtimes and tooling, with secure operation in production.

Skills

LLM orchestration
vLMs
Agentic AI
Inference serving
Edge AI
Kubernetes
Docker
Python
C++
Rust
Cloud platforms
MLOps
CI/CD
APIs and interfaces

Education

Four-year or Graduate Degree in CS/IT/Software Engineering or related
12+ years of work experience in software design/architecture

Tools

Kubernetes
Docker
CUDA

Job description

Job Summary

The next era of AI will be built local, more secure, more mobile, and closer to the work. HP is leading the way in Edge AI. This role provides senior technical leadership and end-to-end architectural oversight of a full-stack Edge AI platform, spanning from silicon and systems hardware at the foundation through model management and lifecycle governance at the top. As the highest-level individual technical authority for the platform, the role sets and owns the technical direction across every layer of the stack — hardware enablement, the security and OS trust foundation, inference serving, agentic runtimes and creation tooling, fleet management, and model management — ensuring the platform behaves as one coherent, secure, and performant system rather than a collection of independent components.

Description

The next era of AI will be built local, more secure, more mobile, and closer to the work. HP is leading the way in Edge AI. This role provides senior technical leadership and end-to-end architectural oversight of a full-stack Edge AI platform, spanning from silicon and systems hardware at the foundation through model management and lifecycle governance at the top. As the highest-level individual technical authority for the platform, the role sets and owns the technical direction across every layer of the stack — hardware enablement, the security and OS trust foundation, inference serving, agentic runtimes and creation tooling, fleet management, and model management — ensuring the platform behaves as one coherent, secure, and performant system rather than a collection of independent components. The role evaluates and introduces technologies, defines cross-layer architecture and interface contracts, and establishes the engineering standards and best practices that optimize development. Working closely with product managers, engineering leaders, firmware and hardware teams, security, quality assurance, and business stakeholders, the role gathers requirements, defines architectural scope, and drives alignment throughout the full development lifecycle — from on-device silicon enablement to model lifecycle governance and edge-to-cloud orchestration.

Responsibilities
  • Own the multi-year technical roadmap and architectural vision for a full-stack Edge AI platform, with a strong focus on orchestrating LLMs, vLMs, and agent-based systems across constrained, on-device, and clustered environments.
  • Define the cross-layer architecture and the interface contracts that connect hardware, OS/security, inference, agentic runtime, and model-management layers so the platform operates as a single, coherent, and upgradeable system.
  • Architect model management, registry, and lifecycle systems — governing versioning, signing, evaluation, promotion, provenance, and rollback of models across a distributed fleet.
  • Set the architecture for agentic AI runtimes and agent-creation tooling — defining how agents are built, sandboxed, permissioned, tool-integrated, governed, and safely operated in production.
  • Drive the inference-serving strategy — model serving, inference gateways, and model/request routing — optimized for throughput, latency, and cost across heterogeneous silicon.
  • Architect the control plane, end-to-end telemetry, and cost-management frameworks that make on-device and clustered deployments deployable, observable, and manageable at scale.
  • Own the security architecture — hardware-rooted chain of trust, secure boot, workload isolation, and sandboxing — ensuring safe execution of agentic workloads.
  • Partner deeply with silicon, firmware, and hardware teams to exploit modern compute platforms and build abstraction layers that let AI workloads deploy across diverse silicon without rewrites.
  • Architect seamless edge-to-cloud handoff frameworks optimized for cost, latency, privacy, and performance, and define when and how workloads run on-device, at the cluster, or in the cloud.
  • Enable multi-modal AI experiences, integrating vision, audio, and text inputs from the runtime through to model management.
  • Design scalable on-device lifecycle management frameworks — including deployment, observability, updateability, and manageability — that hold up across a distributed fleet.
  • Drive cross-functional influence, bringing together experts across software, firmware, hardware, security, and business teams to converge on a unified platform architecture.
  • Communicate technology strategy and the multi-year roadmap to executive leadership, industry partners, and customers, translating deep technical direction into business impact.
  • Serve as a trusted technical advisor and the enterprise's top design authority for Edge AI, influencing enterprise-level decision-making through combined technical and business expertise.
  • Provide architectural guidance, consultation, and design-review authority across all layers, applications, and platforms, resolving cross-layer trade-offs and setting engineering standards.
  • Assess emerging technologies, develop business cases, and shape the platform portfolio in partnership with architects, product leaders, and operations.
  • Ensure effective enablement and training for engineering, services, support, and sales teams.
  • Mentor and develop emerging technical leaders and architects, fostering a culture of innovation and engineering excellence.
Education & Experience Recommended
  • Four-year or Graduate Degree in Computer Science, Information Technology, Software Engineering, or any other related discipline or commensurate work experience or demonstrated competence.
  • Typically has 12+ years of work experience, preferably in software designing & development, software architecture, programming languages, or a related field.

Demonstrated experience architecting across multiple layers of a modern AI stack — from hardware/OS enablement and inference serving to agentic runtimes and model lifecycle — is strongly preferred.

Preferred Certifications
  • Programming Language Certification (Python, C++, Rust, Java, or similar).
  • Cloud or platform architecture certification (AWS, Azure, or CNCF/Kubernetes) is a plus.
Knowledge & Skills
  • LLM, vLM, and multi-modal model architecture and orchestration
  • Agentic AI systems and runtimes (agent harnesses, tool use, sandboxing, governance)
  • Inference serving and optimization (model serving, inference gateways, model/request routing)
  • Edge AI and edge-to-cloud architecture (latency, cost, privacy, on-device constraints)
  • Model management, registry, lifecycle, versioning, and provenance
  • GPU/accelerator computing and heterogeneous silicon (CUDA and related)
  • Hardware/software co-design and silicon abstraction layers
  • Security foundations: chain of trust, secure boot, isolation, sandboxing, and confidential computing
  • Fleet management, control planes, observability, and telemetry
  • Distributed systems and scalability
  • Kubernetes, Docker, and containerized/microservices architecture
  • Python, C++, Rust (systems-level and ML tooling)
  • MLOps / LLMOps and CI/CD for models and agents
  • Cloud platforms (AWS, Microsoft Azure) and hybrid deployment
  • Cost, latency, and performance optimization at scale
  • DevOps and automation
  • Software engineering and full-stack development
  • APIs and interface/contract design across layers
Cross-Org Skills
  • Effective Communication
  • Results Orientation
  • Learning Agility
  • Digital Fluency
  • Customer Centricity
Impact & Scope

Serves as the top technical authority for the Edge AI platform; sets long-term strategic and architectural direction across the full stack and influences multiple functions and disciplines across the organization.

Complexity
  • Invents, develops and introduces new methods and techniques that impact multiple disciplines and work groups.
Disclaimer
  • This job description describes the general nature and level of work performed in this role. It is not intended to be an exhaustive list of all duties, skills, responsibilities, knowledge, etc. These may be subject to change and additional functions may be assigned as needed by management.
Benefits

HP offers a comprehensive benefits package for this position, including:

  • Health insurance
  • Dental insurance
  • Vision insurance
  • Long term/short term disability insurance
  • Employee assistance program
  • Flexible spending account
  • Life insurance
  • Generous time off policies, including;
  • 4-12 weeks fully paid parental leave based on tenure
  • 11 paid holidays
  • Additional flexible paid vacation and sick leave (US benefits overview)

The pay range for this role is $174,050 to $278,450 USD annually with additional opportunities for pay in the form of bonus and/or equity (applies to United States of America candidates only). Pay varies by work location, job-related knowledge, skills, and experience.

Job

Software

Schedule

Full time

Shift

No shift premium (United States of America)

Travel
Relocation
Equal Opportunity Employer (EEO)

HP, Inc. provides equal employment opportunity to all employees and prospective employees, without regard to race, color, religion, sex, national origin, ancestry, citizenship, sexual orientation, age, disability, or status as a protected veteran, marital status, familial status, physical or mental disability, medical condition, pregnancy, genetic predisposition or carrier status, uniformed service status, political affiliation or any other characteristic protected by applicable national, federal, state, and local law(s). Please be assured that you will not be subject to any adverse treatment if you choose to disclose the information requested. This information is provided voluntarily. The information obtained will be kept in strict confidence. For more information, review HP’s EEO Policy or read about your rights as an applicant under the law here: “Know Your Rights: Workplace Discrimination is Illegal"

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Distinguished Technologist, Edge AI Architect
Distinguished Technologist, Edge AI Architect

HP • Palo Alto (CA)

On-site
USD 174,000 - 278,000
Health insurance
Dental insurance
Vision insurance
+5
Distinguished Technologist, Edge AI Architect
Distinguished Technologist, Edge AI Architect

Hewlett Packard Enterprise • Palo Alto (CA), Northern (KY)

Hybrid
USD 174,000 - 278,000
Health insurance
Dental insurance
Vision insurance
+5
Senior Software ML Engineer
Senior Software ML Engineer

HP • Palo Alto (CA)

On-site
USD 165,000 - 260,000
Health insurance
Dental insurance
Vision insurance
+7
Senior Software ML Engineer
Senior Software ML Engineer

HP • Spring (TX)

On-site
USD 165,000 - 260,000
Health insurance
Dental insurance
Vision insurance
+5
Principal Technical Product Marketing Manager, AI Solutions
Principal Technical Product Marketing Manager, AI Solutions

HP • Spring (TX)

On-site
USD 147,000 - 217,000
Health insurance
Dental insurance
Vision insurance
+5
Senior Software ML Engineer
Senior Software ML Engineer

HP Inc. • Palo Alto (CA)

On-site
USD 165,000 - 260,000
Health insurance
Dental insurance
Vision insurance
+5
AI Data Scientist – Enterprise AI
AI Data Scientist – Enterprise AI

HP • Spring (TX)

On-site
USD 131,000 - 205,000
Health insurance
Dental insurance
Vision insurance
+5
Principal AI GTM Programs & Transformation
Principal AI GTM Programs & Transformation

Relha LLC • Spring (TX)

Hybrid
USD 147,000 - 231,000
Health insurance
Vision insurance
Disability insurance
+5
AI Platforms Analytics and Governance Lead
AI Platforms Analytics and Governance Lead

Information Technology Senior Management Forum • Spring (TX)

On-site
USD 131,000 - 205,000
Health insurance
Dental insurance
Vision insurance
+7
Lead AI Software Engineer
Lead AI Software Engineer

Hpiq • San Francisco (CA)

On-site
USD 190,000 - 270,000
Health insurance
Dental insurance
Vision insurance
+1