Senior AI Inference Platform Lead

Akamai Technologies, Inc.; Salt Lake City (UT); On-site; USD 146,000 - 264,000; Full time

Job summary

Akamai Technologies, Inc. invites a Senior II Software Engineer Lead to shape the Akamai Inference Cloud, building OpenAI-compatible endpoints and orchestrating inference workloads across regions.

You will mentor engineers, drive architectural decisions, and optimize containerized AI workloads across distributed systems.

This role emphasizes hands-on leadership, scalable design, and collaboration across teams to deliver high-performance, secure AI platforms.

Qualifications

• 8 years of relevant experience and a Bachelor's degree or its equivalent.
• Hands-on AI inference, model serving, or LLM deployment with knowledge of frameworks (TensorRT, vLLM, TorchServe, Triton).
• Expertise in containerization and orchestration (Kubernetes, Docker) and cloud-native architectures.
• Experience building scalable, high-performance systems with DevOps, CI/CD, and IaC.
• Leadership through mentoring, code quality advocacy, and driving technical solutions.
• Familiar with API design (REST/gRPC) and GPU infrastructure/hardware acceleration.
• Knowledge of observability, monitoring, and debugging distributed systems.

Responsibilities

• Leading the design and implementation of critical platform components for Akamai Inference Cloud, ensuring performance, scalability, and reliability
• Driving technical decisions for your domain, selecting appropriate tools, frameworks, and approaches for AI inference workloads
• Mentoring and guiding engineers on the team through code reviews, design discussions, and technical problem-solving
• Implementing and optimizing containerized AI workloads with hardware-specific optimizations and integrating inference frameworks at scale
• Collaborating across teams to define technical requirements, contribute to platform standards, and ensure operational excellence

Skills

Distributed systems

Cloud services

Platform engineering

AI inference

Model serving

LLM deployment

API design

Education

Bachelor's degree or equivalent

Tools

Kubernetes

Docker

Cloud-native architectures

Job description

Akamai Technologies, Inc. invites a Senior II Software Engineer Lead to shape the Akamai Inference Cloud, building OpenAI-compatible endpoints and orchestrating inference workloads across regions.

You will mentor engineers, drive architectural decisions, and optimize containerized AI workloads across distributed systems.

This role emphasizes hands-on leadership, scalable design, and collaboration across teams to deliver high-performance, secure AI platforms.