Remote Senior AI Inference Platform Lead

Akamai Career Site; United States; Remote; USD 146,000 - 264,000; Full time

Job summary

Akamai Inference Cloud invites a Senior II Software Engineer Lead to shape the AI inference platform that runs OpenAI-compatible endpoints and orchestrates distributed workloads across regions.

You will mentor engineers, make architectural decisions, and optimize containerized AI workloads with GPU acceleration in a cloud-native, CI/CD-driven environment. This role emphasizes technical leadership and cross-team collaboration.

Qualifications

• 8 years of relevant experience and a Bachelor's degree or its equivalent.
• Have solid proficiency in distributed systems, cloud services, and platform engineering.
• Demonstrate hands-on experience with AI inference, model serving, or LLM deployment with working knowledge of inference frameworks (TensorRT, vLLM, TorchServe, Triton).
• Show expertise in containerization and orchestration technologies including Kubernetes, Docker, and cloud-native architectures.
• Have proven experience building scalable, high-performance systems with modern DevOps practices, CI/CD pipelines, and infrastructure-as-code.
• Demonstrate solid technical leadership through mentoring, code quality advocacy, and ability to drive technical solutions for complex problems.
• Show familiarity with API design and development(REST/gRPC patterns), GPU infrastructure and hardware acceleration.
• Have knowledge of observability, monitoring, and debugging distributed systems.

Responsibilities

• Lead the design and implementation of critical platform components for Akamai Inference Cloud, ensuring performance, scalability, and reliability.
• Drive technical decisions for your domain, selecting appropriate tools, frameworks, and approaches for AI inference workloads.
• Mentor and guide engineers on the team through code reviews, design discussions, and technical problem-solving.
• Implement and optimize containerized AI workloads with hardware-specific optimizations and integrating inference frameworks at scale.
• Collaborate across teams to define technical requirements, contribute to platform standards, and ensure operational excellence.

Skills

Distributed systems

Cloud services

Platform engineering

AI inference

Model serving

LLM deployment

REST/gRPC

GPU acceleration

Observability

API design

Education

Bachelor’s degree or equivalent

Tools

Kubernetes

Docker

TensorRT

TorchServe

Triton

vLLM

CI/CD

Terraform

Job description

Akamai Inference Cloud invites a Senior II Software Engineer Lead to shape the AI inference platform that runs OpenAI-compatible endpoints and orchestrates distributed workloads across regions.

You will mentor engineers, make architectural decisions, and optimize containerized AI workloads with GPU acceleration in a cloud-native, CI/CD-driven environment. This role emphasizes technical leadership and cross-team collaboration.