Senior AI Inference Data Plane Engineer (Remote)

DigitalOcean; Seattle (WA); Remote; USD 167,200 - 209,000; Full time

Benefits offered by this job

Career development resources

Competitive benefits package

Equity compensation options

Job summary

A pioneering cloud service provider in Seattle seeks a Senior Engineer 2 for its AI Inference Data Plane team. This role requires designing and delivering high-scale, resilient data services. Responsibilities include technical leadership, system design, performance optimization, mentorship, and operational excellence. Candidates should have expertise in distributed systems, AI/ML, and strong software engineering skills, particularly in GoLang or Python. Competitive salary range from $167,200 to $209,000 with remote work options.

Qualifications

• Strong experience with microservices and messaging systems.
• Hands-on experience hosting large language or multimodal models.
• Familiarity with distributed inference serving frameworks.

Responsibilities

• Drive the end-to-end design, development, and delivery.
• Architect and refine system design proposals.
• Implement and optimize distributed inference hosting.
• Work cross-functionally with different teams.
• Coach and mentor junior engineers.
• Maintain and operate critical, high-scale services.

Skills

Distributed Systems Expertise

AI/ML Domain Knowledge

Inference Frameworks

Hardware & Interconnects

Architecture Proficiency

Software Engineering

Cloud Operations

Open Source Mindset

Job description

A pioneering cloud service provider in Seattle seeks a Senior Engineer 2 for its AI Inference Data Plane team. This role requires designing and delivering high-scale, resilient data services. Responsibilities include technical leadership, system design, performance optimization, mentorship, and operational excellence. Candidates should have expertise in distributed systems, AI/ML, and strong software engineering skills, particularly in GoLang or Python. Competitive salary range from $167,200 to $209,000 with remote work options.