Senior AI Inference Data Plane Engineer — Remote

DigitalOcean; San Francisco (CA); Remote; USD 167,200 - 209,000; Full time

Benefits offered by this job

Competitive salary

Career development opportunities

Comprehensive benefits package

Equity compensation

Flexible time off policy

Job summary

A leading cloud service provider is seeking a Senior Engineer 2 for their AI Inference Data Plane team. This remote role focuses on designing and developing high-scale, resilient data plane services that enhance AI-driven applications. The ideal candidate will have strong expertise in distributed systems, AI/ML technologies, and excellent programming skills in GoLang or Python. The position includes a competitive salary range of $167,200 to $209,000 and additional benefits for professional development and employee well-being.

Qualifications

• Strong experience with microservices, messaging systems, databases, and infrastructure as code.
• Hands‑on experience hosting large language or multimodal models using inference engines.
• Familiarity with distributed inference serving frameworks.

Responsibilities

• Drive the end‑to‑end design, development, and delivery of critical data plane components.
• Architect and refine system design proposals for high‑scale AI inference.
• Implement and optimise distributed inference hosting.

Skills

Distributed Systems Expertise

AI/ML Domain Knowledge

Inference Frameworks

Hardware & Interconnects

Architecture Proficiency

Software Engineering

Cloud Operations

Open Source Mindset

Tools

GoLang

Python

gRPC

Job description

A leading cloud service provider is seeking a Senior Engineer 2 for their AI Inference Data Plane team. This remote role focuses on designing and developing high-scale, resilient data plane services that enhance AI-driven applications. The ideal candidate will have strong expertise in distributed systems, AI/ML technologies, and excellent programming skills in GoLang or Python. The position includes a competitive salary range of $167,200 to $209,000 and additional benefits for professional development and employee well-being.