Senior AI Platform Lead - Edge & Cloud

Akamai Technologies, Inc.; Annapolis (MD); On-site; USD 146,000 - 264,000; Full time

Benefits offered by this job

Healthcare

401K

PTO

Sick time

Parental leave

Employee assistance program

Job summary

Akamai Technologies, Inc. is seeking a Senior II Software Engineer Lead to drive design and implementation of AI inference platform components across regions. You will mentor engineers, influence technical direction, and ensure delivery of high-performance, scalable systems for OpenAI-compatible endpoints.

You will lead containerized workloads, apply hardware-optimized AI strategies, and collaborate across teams to define requirements and standards, ensuring reliable, secure operations.

Qualifications

• 8 years of relevant experience and a Bachelor's degree or its equivalent.
• Solid proficiency in distributed systems, cloud services, and platform engineering.
• Hands-on experience with AI inference, model serving, or LLM deployment with frameworks TensorRT, vLLM, TorchServe, Triton.
• Expertise in containerization and orchestration with Kubernetes and Docker; cloud-native architectures.
• Experience building scalable, high-performance systems with DevOps, CI/CD, and infrastructure-as-code.
• Proven technical leadership through mentoring, design reviews, and driving complex solutions.

Responsibilities

• Lead design and implementation of platform components for Akamai Inference Cloud with focus on performance and reliability.
• Shape technical direction for AI inference workloads and select appropriate tools and approaches.
• Mentor engineers through code reviews, design discussions, and problem-solving sessions.
• Implement and optimize containerized AI workloads with hardware-specific optimizations.
• Collaborate across teams to define requirements, standards, and ensure operational excellence.

Skills

Distributed systems

Cloud services

Platform engineering

AI inference

LLM deployment

Kubernetes

Docker

CI/CD

Infrastructure as code

API design (REST/gRPC)

GPU infra & acceleration

Observability & debugging

Technical leadership

Education

Bachelor's degree or equivalent

Tools

TensorRT

vLLM

TorchServe

Triton

Kubernetes

Docker

Terraform

Job description

Akamai Technologies, Inc. is seeking a Senior II Software Engineer Lead to drive design and implementation of AI inference platform components across regions. You will mentor engineers, influence technical direction, and ensure delivery of high-performance, scalable systems for OpenAI-compatible endpoints.

You will lead containerized workloads, apply hardware-optimized AI strategies, and collaborate across teams to define requirements and standards, ensuring reliable, secure operations.