Senior AI Platform Lead - Edge & Cloud (Remote)

Akamai Technologies, Inc.; Cambridge (MA); On-site; USD 146,000 - 264,000; Full time

Benefits offered by this job

Healthcare

401K savings

Paid time off

Parental leave

Employee assistance program

FlexBase program

Job summary

Akamai is seeking a Senior II Software Engineer Lead for the Inference Cloud team in the US. You will lead design and implementation of AI inference platform components, delivering OpenAI-compatible endpoints and scalable workloads across regions.

You will mentor engineers, drive technical direction, and collaborate across teams to ensure performance, reliability, and operational excellence in cloud-native architectures and edge deployments.

Qualifications

• 8 years of relevant experience in software engineering
• Bachelor's degree or equivalent
• Strong background in distributed systems and cloud services
• Hands-on AI inference, model serving, or LLM deployment
• Experience with Kubernetes, Docker, and cloud-native architectures
• Experience with CI/CD and infrastructure-as-code
• Proven technical leadership and mentorship

Responsibilities

• Lead design and implementation of critical platform components for Akamai Inference Cloud, ensuring performance, scalability, and reliability
• Drive technical decisions for AI inference workloads and tool choices
• Mentor engineers through code reviews and design discussions
• Implement and optimize containerized AI workloads with hardware-specific optimizations
• Collaborate across teams to define requirements and uphold operational excellence

Skills

Distributed systems

Cloud services

Platform engineering

AI inference

Model serving

LLM deployment

Kubernetes

Docker

CI/CD

Infrastructure-as-code

API design

REST/gRPC

Observability

Monitoring

Debugging

Technical leadership

Education

Bachelor's degree or equivalent

Tools

Kubernetes

Docker

TensorRT

TorchServe

Triton

vLLM

Terraform

CI/CD tooling

Job description

Akamai is seeking a Senior II Software Engineer Lead for the Inference Cloud team in the US. You will lead design and implementation of AI inference platform components, delivering OpenAI-compatible endpoints and scalable workloads across regions.

You will mentor engineers, drive technical direction, and collaborate across teams to ensure performance, reliability, and operational excellence in cloud-native architectures and edge deployments.