Senior AI Inference Platform Lead

Akamai Technologies, Inc.; Austin (TX); On-site; USD 146,000 - 264,000; Full time

Benefits offered by this job

FlexBase program

Hybrid/work-from-home option

Job summary

Akamai is seeking a Senior II Software Engineer Lead for the Inference Cloud team to drive design and implementation of AI platform components, delivering OpenAI-compatible endpoints while orchestrating inference workloads across regions.

You will mentor engineers, influence technical direction, and optimize containerized AI workloads using Kubernetes, Docker, and cloud-native architectures to build scalable, high-performance systems.

Qualifications

• 8 years of relevant experience and a Bachelor's degree or its equivalent.
• Experience with distributed systems, cloud services, and platform engineering.
• Hands-on experience with AI inference, model serving, or LLM deployment and inference frameworks (TensorRT, vLLM, TorchServe, Triton).
• Expertise in containerization and orchestration technologies (Kubernetes, Docker, cloud-native architectures).
• Experience building scalable, high-performance systems with modern DevOps practices, CI/CD, and infrastructure-as-code.
• Strong technical leadership through mentoring, code quality advocacy, and driving complex solutions.
• Familiarity with API design (REST/gRPC) and GPU infrastructure.

Responsibilities

• Leading the design and implementation of critical platform components for Akamai Inference Cloud, ensuring performance, scalability, and reliability.
• Driving technical decisions for your domain, selecting tools, frameworks, and approaches for AI inference workloads.
• Mentoring and guiding engineers through code reviews, design discussions, and problem-solving.
• Implementing and optimizing containerized AI workloads with hardware-specific optimizations and integrating inference frameworks at scale.
• Collaborating across teams to define requirements, contribute to platform standards, and ensure operational excellence.

Skills

Distributed systems

Cloud services

Platform engineering

AI inference

API design

Leadership

Code reviews

Education

Bachelor’s degree or equivalent

Tools

Kubernetes

Docker

Cloud-native architectures

TensorRT

vLLM

TorchServe

Triton

Job description

Akamai is seeking a Senior II Software Engineer Lead for the Inference Cloud team to drive design and implementation of AI platform components, delivering OpenAI-compatible endpoints while orchestrating inference workloads across regions.

You will mentor engineers, influence technical direction, and optimize containerized AI workloads using Kubernetes, Docker, and cloud-native architectures to build scalable, high-performance systems.