Senior AI Platform Lead - Edge & Inference Cloud (Remote)

Akamai Technologies, Inc.; Augusta (ME); On-site; USD 146,000 - 264,000; Full time

Benefits offered by this job

Healthcare benefits

401K plan

Paid time off (PTO)

Employee stock purchase plan

Job summary

Akamai Technologies, Inc. is seeking a Senior II Software Engineer Lead to drive design and delivery of the Akamai Inference Cloud platform.

You will work hands-on, optimize AI workloads, and guide other engineers to build high-performance, scalable systems with end-to-end ownership. You will lead architecture decisions for AI inference, model serving, and deployment, while collaborating across teams to ensure reliability and security in a globally distributed environment.

Qualifications

• 8 years of relevant experience and a Bachelor's degree or its equivalent.
• Solid proficiency in distributed systems, cloud services, and platform engineering.
• Hands-on experience with AI inference, model serving, or LLM deployment and working knowledge of inference frameworks (TensorRT, vLLM, TorchServe, Triton).
• Expertise in containerization and orchestration technologies including Kubernetes, Docker, and cloud-native architectures.
• Experience building scalable, high-performance systems with modern DevOps practices, CI/CD, and infrastructure-as-code.
• Demonstrated technical leadership through mentoring, code quality advocacy, and driving solutions.

Responsibilities

• Lead design and implementation of critical platform components for Akamai Inference Cloud, ensuring performance and reliability.
• Drive technical decisions for AI inference workloads and select appropriate tools and approaches.
• Mentor engineers through code reviews, design discussions, and problem solving.
• Implement and optimize containerized AI workloads with hardware-specific optimizations.
• Collaborate across teams to define requirements, contribute to standards, and ensure operational excellence.

Skills

Distributed systems

Cloud services

Platform engineering

AI inference

Model serving

LLM deployment

TensorRT

vLLM

TorchServe

Triton

Kubernetes

Docker

CI/CD pipelines

Infrastructure as code

Technical leadership

API design (REST/gRPC)

GPU acceleration

Observability

Education

Bachelor's degree or equivalent

Tools

Kubernetes

Docker

Job description

Akamai Technologies, Inc. is seeking a Senior II Software Engineer Lead to drive design and delivery of the Akamai Inference Cloud platform.

You will work hands-on, optimize AI workloads, and guide other engineers to build high-performance, scalable systems with end-to-end ownership. You will lead architecture decisions for AI inference, model serving, and deployment, while collaborating across teams to ensure reliability and security in a globally distributed environment.