AI Inference Platform Lead (Remote/Hybrid)

Akamai Technologies, Inc.; Helena (MT); Hybrid; USD 146,000 - 264,000; Full time

Benefits offered by this job

FlexBase program

Job summary

Akamai Technologies, Inc. is seeking a Senior II Software Engineer Lead for the Akamai Inference Cloud Team within the Cloud Technology Group. You will design and deploy AI platforms that enable OpenAI-compatible endpoints and orchestrate inference workloads across regions.

In this role you will mentor engineers, influence technical direction, and ensure delivery of high-quality, scalable solutions in a distributed, cloud-native environment.

Qualifications

• 8 years of relevant experience and a Bachelor's degree or its equivalent.
• Hands-on experience with AI inference, model serving, or LLM deployment.
• Proficiency in containerization and orchestration (Kubernetes, Docker).
• Experience with CI/CD pipelines and infrastructure-as-code (IaC).
• Strong technical leadership through mentoring and design discussions.

Responsibilities

• Lead the design and implementation of critical platform components for Akamai Inference Cloud, ensuring performance, scalability, and reliability.
• Drive technical decisions for AI inference workloads and select appropriate tools and frameworks.
• Mentor engineers through code reviews, design discussions, and problem solving.
• Implement and optimize containerized AI workloads with hardware-specific optimizations.
• Collaborate across teams to define requirements and ensure operational excellence.

Skills

Distributed systems

Cloud services

Platform engineering

AI inference

Kubernetes

Docker

REST/gRPC

CI/CD

Observability

Education

Bachelor's degree

Tools

Kubernetes

Docker

TensorRT

vLLM

TorchServe

Triton

Job description

Akamai Technologies, Inc. is seeking a Senior II Software Engineer Lead for the Akamai Inference Cloud Team within the Cloud Technology Group. You will design and deploy AI platforms that enable OpenAI-compatible endpoints and orchestrate inference workloads across regions.

In this role you will mentor engineers, influence technical direction, and ensure delivery of high-quality, scalable solutions in a distributed, cloud-native environment.