Senior AI Platform Lead – Inference Cloud (Hybrid)

Akamai Technologies, Inc.; Salem (OR); On-site; USD 146,000 - 264,000; Full time

Benefits offered by this job

Healthcare

401K savings plan

Company holidays (PTO)

Sick time

Parental leave

Employee Stock Purchase Plan (ESPP)

Equity awards

Job summary

Akamai Technologies, Inc. is seeking a Senior II Software Engineer Lead to drive design and implementation of the Akamai Inference Cloud platform.

You will lead hands-on work delivering OpenAI-compatible endpoints while orchestrating inference workloads across regions and mentoring engineers to ensure high-quality, scalable solutions. You will shape technical direction, select tools, frameworks, and approaches for AI inference, containerize workloads, and collaborate across teams to set platform

Qualifications

• 8 years of relevant experience or equivalent
• Solid proficiency in distributed systems, cloud services, and platform engineering
• Hands-on experience with AI inference, model serving, or LLM deployment with inference frameworks (TensorRT, vLLM, TorchServe, Triton)
• Expertise in containerization and orchestration technologies including Kubernetes, Docker, and cloud-native architectures
• Experience building scalable, high-performance systems with modern DevOps practices, CI/CD pipelines, and infrastructure-as-code
• Strong technical leadership through mentoring and code quality advocacy
• Familiarity with API design and development (REST/gRPC) and GPU infrastructure

Responsibilities

• Leading the design and implementation of critical platform components for Akamai Inference Cloud, ensuring performance, scalability, and reliability
• Driving technical decisions for your domain, selecting tools, frameworks, and approaches for AI inference workloads
• Mentoring and guiding engineers through code reviews, design discussions, and problem-solving
• Implementing and optimizing containerized AI workloads with hardware-specific optimizations and integrating inference frameworks at scale
• Collaborating across teams to define technical requirements, contribute to platform standards, and ensure operational excellence

Skills

Distributed systems

Cloud services

Platform engineering

AI inference

Model serving

LLM deployment

Inference frameworks

Kubernetes

Docker

CI/CD

Infrastructure as code

API design

GPU hardware

Observability

Technical leadership

REST/gRPC

DevOps

Education

Bachelor's degree

Tools

Kubernetes

Docker

TensorRT

TorchServe

Triton

vLLM

Job description

Akamai Technologies, Inc. is seeking a Senior II Software Engineer Lead to drive design and implementation of the Akamai Inference Cloud platform.

You will lead hands-on work delivering OpenAI-compatible endpoints while orchestrating inference workloads across regions and mentoring engineers to ensure high-quality, scalable solutions. You will shape technical direction, select tools, frameworks, and approaches for AI inference, containerize workloads, and collaborate across teams to set platform