Senior AI Software Engineer: Edge-to-Cloud Orchestration

HP; San Francisco (CA); On-site; USD 149,000 - 240,000; Full time

Benefits offered by this job

Health insurance

Dental insurance

Vision insurance

Long term/short term disability

Employee assistance program

Flexible spending account

Life insurance

Generous time off (parental leave, 11+

holidays

Job summary

HP IQ is seeking a Senior Software Engineer to design and develop high‑performance services that support AI workloads across edge and cloud environments. You will build APIs, microservices, and an orchestration runtime to coordinate LLMs, tools, and edge devices.

You will work with AI researchers and infrastructure teams to ensure scalable, secure, and observable systems, including robust logging, monitoring, and alerting for reliable operation.

Qualifications

• 5+ years in backend software development (Java/C++/Python)
• LLM integration into multi-agent systems; agent orchestration & memory/context management
• Experience with prompting, tool use, task decomposition, structured outputs
• Distributed systems, microservices, cloud-native apps
• Secure, privacy-aware interfaces between models, devices, and external services
• SQL/NoSQL databases and data streaming technologies
• Strong problem-solving in fast-paced, agile environments

Responsibilities

• Design, build, and maintain scalable services powering AI-driven apps
• Develop APIs and microservices linking cloud AI models with edge devices
• Optimize data pipelines and storage for real-time AI inference
• Implement security/privacy best practices for distributed AI systems
• Collaborate with AI researchers, infra engineers, and frontend teams
• Build and optimize an agent orchestration runtime for multi-step reasoning across LLMs

Skills

Backend development

Java

C++

Python

LLM integration

Agent orchestration

Cloud-native & distributed systems

Security & privacy

SQL/NoSQL databases

Data streaming

Tools

TensorFlow Lite

ONNX Runtime

CoreML

Job description

HP IQ is seeking a Senior Software Engineer to design and develop high‑performance services that support AI workloads across edge and cloud environments. You will build APIs, microservices, and an orchestration runtime to coordinate LLMs, tools, and edge devices.

You will work with AI researchers and infrastructure teams to ensure scalable, secure, and observable systems, including robust logging, monitoring, and alerting for reliable operation.