Senior AI Software Engineer — Edge & Cloud AI Platforms

Hp Iq; United States; Remote; USD 149,000 - 240,000; Full time

Benefits offered by this job

Health insurance

Dental insurance

Vision insurance

Disability insurance

Employee assistance program

Flexible spending account

Life insurance

Generous time off policies

Job summary

HP IQ is seeking a Senior Software Engineer to design and develop high-performance, scalable services that power AI workloads across edge and cloud environments. You will build APIs and microservices that connect cloud-based models to edge devices and collaborate with researchers and engineers.

The role emphasizes security, memory management, and robust logging/monitoring, with a strong focus on multi-agent orchestration and real-time data processing.

Qualifications

• 5+ years of backend software development experience.
• Strong experience in Java, C++, or Python.
• Proficient in LLM integration into multi-agent systems.
• Experience with distributed systems and cloud-native apps.
• Knowledge of secure, privacy-aware interfaces between models, devices, and services.
• Familiarity with SQL and NoSQL databases and data streaming.
• Strong problem-solving skills in a fast-paced environment.

Responsibilities

• Design, build, and maintain services powering AI-driven applications with scalability and performance.
• Develop APIs and microservices connecting cloud-based models to edge devices.
• Optimize data pipelines and storage for real-time AI inference.
• Implement security and privacy best practices for distributed AI systems.
• Collaborate with researchers, infra engineers, and frontend teams on end-to-end solutions.
• Build and optimize an agent orchestration runtime for tool use, memory management, and multi-step reasoning across LLMs.
• Develop logging, monitoring, and alerting to ensure reliability.

Skills

Java

C++

Python

LLM integration

Agent orchestration

Distributed systems

Cloud-native

Security/privacy

SQL/NoSQL databases

Edge computing basics

Tools

TensorFlow Lite

ONNX Runtime

CoreML

Job description

HP IQ is seeking a Senior Software Engineer to design and develop high-performance, scalable services that power AI workloads across edge and cloud environments. You will build APIs and microservices that connect cloud-based models to edge devices and collaborate with researchers and engineers.

The role emphasizes security, memory management, and robust logging/monitoring, with a strong focus on multi-agent orchestration and real-time data processing.