Lead AI Software Engineer — Edge-to-Cloud AI Systems

HP; San Francisco (CA); On-site; USD 190,000 - 270,000; Full time

Benefits offered by this job

Health insurance

Dental insurance

Vision insurance

Disability insurance

Employee assistance program

Flexible spending account

Life insurance

Generous time off

Parental leave

Holidays

Flexible vacation and sick leave

Job summary

HP IQ, HP’s AI innovation lab, seeks a Lead Software Engineer to design and develop high-performance services that power AI workloads across edge and cloud environments. You will build APIs and microservices to connect cloud AI models with edge devices and optimize data pipelines for real-time AI processing.

Collaborate with AI researchers, infra engineers, and frontend developers to deliver end-to-end AI-driven solutions while ensuring security and privacy in distributed systems.

Qualifications

• 10+ years of backend software development experience.
• Strong proficiency in Java, C++, or Python.
• LLM integration into multi-agent systems with agent orchestration and memory management.
• Distributed systems, microservices, and cloud-native apps experience.
• Secure, privacy-aware interfaces between models, devices, and external services.
• SQL/NoSQL databases and data streaming technologies.
• Excellent problem-solving in a fast-paced, agile environment.

Responsibilities

• Design, build, and maintain services powering AI-driven applications for edge and cloud.
• Develop APIs and microservices enabling cloud models to work with edge devices.
• Optimize data pipelines and storage for real-time AI inference.
• Implement security and privacy best practices for distributed AI systems.
• Collaborate with AI researchers, infra engineers, and frontend developers.
• Build and optimize an agent orchestration runtime for tool use and memory management across LLMs.
• Develop robust logging, monitoring, and alerting for reliability.

Skills

Backend dev

Java

C++

Python

LLM integration

Agent orchestration

Tool use

Memory management

Distributed systems

Cloud-native

Security & privacy

SQL/NoSQL

Data streaming

Agile

Job description

HP IQ, HP’s AI innovation lab, seeks a Lead Software Engineer to design and develop high-performance services that power AI workloads across edge and cloud environments. You will build APIs and microservices to connect cloud AI models with edge devices and optimize data pipelines for real-time AI processing.

Collaborate with AI researchers, infra engineers, and frontend developers to deliver end-to-end AI-driven solutions while ensuring security and privacy in distributed systems.