Senior AI Inference Cloud Lead (Remote)

Akamai Technologies; United States; Remote; USD 146,000 - 264,000; Full time

Benefits offered by this job

Healthcare

401K savings plan

Paid time off

Sick time

Parental leave

Employee assistance program

Employee stock purchase plan

Job summary

Akamai Inference Cloud team is building a scalable AI inference platform that delivers OpenAI-compatible endpoints and orchestrates AI workloads globally. You will guide engineers, influence technical direction, and ensure high-quality, scalable solutions.

The role emphasizes hands-on leadership in distributed systems, cloud services, and modern DevOps, with a focus on performance, reliability, and scalability across regions.

Qualifications

• Experience designing and implementing distributed AI platforms.
• Hands-on AI inference, model serving, or LLM deployment experience.
• Strong knowledge of containerization and orchestration (Kubernetes, Docker).
• Experience with CI/CD and infrastructure-as-code practices.

Responsibilities

• Lead design and implementation of critical platform components for Akamai Inference Cloud.
• Drive technical decisions for AI inference workloads and platform tooling.
• Mentor engineers through reviews, design discussions, and problem solving.
• Implement and optimize containerized AI workloads with hardware-specific optimizations.
• Collaborate across teams to define requirements and uphold operational excellence.

Skills

Distributed systems

Cloud services

Platform engineering

AI inference

Model serving

LLM deployment

Kubernetes

Docker

CI/CD

Infrastructure as code

API design

REST

gRPC

GPU infrastructure

Observability

Mentoring

Education

Bachelor's degree or equivalent

Tools

TensorRT

vLLM

TorchServe

Triton

Job description

Akamai Inference Cloud team is building a scalable AI inference platform that delivers OpenAI-compatible endpoints and orchestrates AI workloads globally. You will guide engineers, influence technical direction, and ensure high-quality, scalable solutions.

The role emphasizes hands-on leadership in distributed systems, cloud services, and modern DevOps, with a focus on performance, reliability, and scalability across regions.