Senior AI Inference Cloud Lead

Akamai Technologies, Inc.; Nashville (TN); On-site; USD 146,000 - 264,000; Full time

Benefits offered by this job

Health insurance

401K savings plan

PTO (vacation)

Job summary

Akamai Technologies, Inc. in the United States is hiring a Senior II Software Engineer Lead to drive design and implementation of parts of the Akamai Inference Cloud platform. You will deliver OpenAI-compatible endpoints and orchestrate inference workloads across regions.

You will mentor engineers, steer technical directions, optimize containerized AI workloads, and collaborate across teams to define standards and ensure operational excellence.

Qualifications

• 8 years of relevant experience and a Bachelor's degree or its equivalent.
• Hands-on with AI inference, model serving, or LLM deployment.
• Experience with containerization and orchestration (Kubernetes, Docker).
• Proven ability to drive technical direction and mentor engineers.
• Familiarity with REST/gRPC APIs and GPU infrastructure.

Responsibilities

• Lead design and implementation of platform components for Akamai Inference Cloud.
• Drive technical decisions for AI inference workloads and tools.
• Mentor engineers through code reviews and design discussions.
• Implement and optimize containerized AI workloads with hardware-specific tweaks.
• Collaborate across teams to define requirements and ensure operational excellence.

Skills

Distributed systems

Cloud services

Platform engineering

AI inference / model serving

Inference frameworks (TensorRT, vLLM,

TorchServe / Triton

Kubernetes

Docker

CI/CD / DevOps

Observability / debugging

API design (REST/gRPC)

GPU infrastructure & hardware accel

Education

Bachelor's degree or equivalent

Tools

Kubernetes

Docker

Job description

Akamai Technologies, Inc. in the United States is hiring a Senior II Software Engineer Lead to drive design and implementation of parts of the Akamai Inference Cloud platform. You will deliver OpenAI-compatible endpoints and orchestrate inference workloads across regions.

You will mentor engineers, steer technical directions, optimize containerized AI workloads, and collaborate across teams to define standards and ensure operational excellence.