Lead AI Software Engineer

HP; San Francisco (CA); On-site; USD 190,000 - 270,000; Full time

Benefits offered by this job

Health insurance

Dental insurance

Vision insurance

Disability insurance

Employee assistance program

Flexible spending account

Life insurance

Generous time off

Parental leave

Holidays

Flexible vacation and sick leave

Job summary

HP IQ, HP’s AI innovation lab, seeks a Lead Software Engineer to design and develop high-performance services that power AI workloads across edge and cloud environments. You will build APIs and microservices to connect cloud AI models with edge devices and optimize data pipelines for real-time AI processing.

Collaborate with AI researchers, infra engineers, and frontend developers to deliver end-to-end AI-driven solutions while ensuring security and privacy in distributed systems.

Qualifications

• 10+ years of backend software development experience.
• Strong proficiency in Java, C++, or Python.
• LLM integration into multi-agent systems with agent orchestration and memory management.
• Distributed systems, microservices, and cloud-native apps experience.
• Secure, privacy-aware interfaces between models, devices, and external services.
• SQL/NoSQL databases and data streaming technologies.
• Excellent problem-solving in a fast-paced, agile environment.

Responsibilities

• Design, build, and maintain services powering AI-driven applications for edge and cloud.
• Develop APIs and microservices enabling cloud models to work with edge devices.
• Optimize data pipelines and storage for real-time AI inference.
• Implement security and privacy best practices for distributed AI systems.
• Collaborate with AI researchers, infra engineers, and frontend developers.
• Build and optimize an agent orchestration runtime for tool use and memory management across LLMs.
• Develop robust logging, monitoring, and alerting for reliability.

Skills

Backend dev

Java

C++

Python

LLM integration

Agent orchestration

Tool use

Memory management

Distributed systems

Cloud-native

Security & privacy

SQL/NoSQL

Data streaming

Agile

Job description

Who We Are

HP IQ is HP’s new AI innovation lab. Combining startup agility with HP’s global scale, we’re building intelligent technologies that redefine how the world works, creates, and collaborates.

We’re assembling a diverse, world-class team—engineers, designers, researchers, and product minds—focused on creating an intelligent ecosystem across HP’s portfolio. Together, we’re developing intuitive, adaptive solutions that spark creativity, boost productivity, and make collaboration seamless.

We create breakthrough solutions that make complex tasks feel effortless, teamwork more natural, and ideas more impactful—always with a human-centric mindset.

By embedding AI advancements into every HP product and service, we’re expanding what’s possible for individuals, organisations, and the future of work.

Join us as we reinvent work, so people everywhere can do their best work.

About The Role

The AI team is building cutting-edge solutions that bring the power of AI directly to edge devices while seamlessly integrating with cloud infrastructure. We are looking for a Lead Software Engineer to design and develop high-performance, scalable services to support AI workloads across edge and cloud environments.

What You Might Do

• Design, build, and maintain services that power AI-driven applications, ensuring scalability and performance.
• Develop APIs and microservices that facilitate seamless integration between cloud-based AI models and edge devices.
• Optimize data pipelines and storage solutions for real-time AI inference and processing.
• Implement security and privacy best practices for distributed AI systems.
• Work closely with AI researchers, infrastructure engineers, and frontend developers to deliver end-to-end AI-driven solutions.
• Build and optimize an agent orchestration runtime that enables tool use, memory management, and multi-step reasoning across LLMs, APIs, and edge-connected systems.
• Develop robust logging, monitoring, and alerting systems to ensure system reliability.

Essential Qualifications

• 10+ years of experience in backend software development, with strong proficiency in Java, C++, or Python.
• Proficient in LLM integration into multi-agent systems with strong understanding of agent orchestration, tool use, and memory/context management.
• Comfortable tinkering with LLMs via prompting and experienced with tools use, task decomposition, and structured outputs.
• Experience building distributed systems, microservices, and cloud-native applications.
• Strong knowledge with building secure, privacy-aware interfaces between models, devices, and external services.
• Familiarity with database management systems (SQL and NoSQL) and data streaming technologies.
• Strong problem-solving skills and ability to work in a fast-paced, agile environment.

Preferred Skills

• Experience with AI model deployment and integration into backend services.
• Knowledge of edge computing, networking, and security best practices.
• Exposure to cloud-edge hybrid architectures and distributed AI workloads.
• Familiarity with on-device AI frameworks such as TensorFlow Lite, ONNX Runtime, or CoreML.

Salary range: $190,000 - $270,000

Compensation & Benefits (Full-Time Employees)

The salary range for this role is listed above. Final salary offered is based upon multiple factors including individual job-related qualifications, education, experience, knowledge and skills.

At HP IQ, we offer a competitive and comprehensive benefits package, including:

• Health insurance
• Dental insurance
• Vision insurance
• Long term/short term disability insurance
• Employee assistance programFlexible spending account
• Life insurance
• Generous time off policies, including;
  • 4-12 weeks fully paid parental leave based on tenure
  • 11 paid holidays
  • Additional flexible paid vacation and sick leave (US benefits overview)

Why HP IQ?

HP IQ is HP’s new AI innovation lab, building the intelligence to empower humanity—reimagining how we work, create, and connect to shape the future of work.

• Innovative Work
  Help shape the future of intelligent computing and workplace transformation.
• Autonomy and Agility
  Work with the speed and focus of a startup, backed by HP’s scale.
• Meaningful Impact
  Build AI-powered solutions that help people and organisations thrive.
• Flexible Work Environment
  Freedom and flexibility to do your best work.
• Forward-Thinking Culture
  We learn fast, stay future-focused, and imagine what comes next—together.

Equal Opportunity Employer (EEO) Statement

HP, Inc. provides equal employment opportunity to all employees and prospective employees, without regard to race, color, religion, sex, national origin, ancestry, citizenship, sexual orientation, age, disability, or status as a protected veteran, marital status, familial status, physical or mental disability, medical condition, pregnancy, genetic predisposition or carrier status, uniformed service status, political affiliation or any other characteristic protected by applicable national, federal, state, and local law(s).

Please be assured that you will not be subject to any adverse treatment if you choose to disclose the information requested. This information is provided voluntarily. The information obtained will be kept in strict confidence.

If you’d like more information about HP’s EEO Policy or your EEO rights as an applicant under the law, please click here: Equal Employment Opportunity is the Law Equal Employment Opportunity is the Law – Supplement