Edge-Cloud AI Engineer: Build Scalable AI Services

HP Inc.; San Francisco (CA); On-site; USD 127,000 - 175,000; Full time

Benefits offered by this job

Health insurance

Dental insurance

Vision insurance

Parental leave

Flexible spending account

Job summary

HP IQ, HP’s AI innovation lab, seeks an AI Software Engineer to design high-performance services for edge and cloud AI workloads. You will build APIs, optimize data pipelines, and partner with researchers to create end-to-end AI-driven solutions.

Role emphasizes agent orchestration, tool use, memory management, and secure distributed AI systems within a fast-moving, cross-functional team environment.

Qualifications

• Requires at least a Masters in Computer Science, Engineering, Data Science, AI or related fields.
• 1+ years of backend software development experience with Python, Java, and C++.
• Experience with integrating LLMs into multi-agent systems and orchestration.
• Familiarity with prompting, tool use, task decomposition, and structured outputs.
• Knowledge of SQL and NoSQL DBs and data streaming technologies.
• Strong problem-solving skills in a fast-paced agile environment.

Responsibilities

• Design and develop high-performance, scalable AI services for edge and cloud environments.
• Develop APIs and microservices to connect cloud AI models with edge devices.
• Optimize data pipelines for real-time AI inference and processing.
• Collaborate with AI researchers, infra engineers, and frontend developers on end-to-end solutions.
• Build and optimize an agent orchestration runtime for multi-step reasoning across systems.
• Support security and privacy best practices for distributed AI systems.

Skills

Python

Java

C++

LLM integration

Agent orchestration

Prompting

Memory/context management

SQL/NoSQL

Data streaming

Problem solving

Education

Masters in Computer Science / Engineering / Data Science / AI

Tools

PyTorch

TensorFlow Lite

ONNX Runtime

CoreML

Job description

HP IQ, HP’s AI innovation lab, seeks an AI Software Engineer to design high-performance services for edge and cloud AI workloads. You will build APIs, optimize data pipelines, and partner with researchers to create end-to-end AI-driven solutions.

Role emphasizes agent orchestration, tool use, memory management, and secure distributed AI systems within a fast-moving, cross-functional team environment.