Senior AI Inference Platform Lead

Akamai Technologies, Inc.; Boise (ID); Hybrid; USD 146,000 - 264,000; Full time

Benefits offered by this job

FlexBase program

Remote/hybrid work options

Job summary

Akamai Technologies, Inc. is seeking a Senior II Software Engineer Lead to guide the design and delivery of a globally distributed AI inference platform. You will shape architecture, optimize OpenAI-compatible endpoints, and orchestrate workloads across regions while mentoring a team of engineers.

You will master containerized AI workloads, contribute to platform standards, and ensure high performance, reliability, and scalability in a fast-moving edge-cloud environment.

Qualifications

• 8 years of relevant experience or equivalent.
• Bachelor's degree or its equivalent.
• Solid proficiency in distributed systems, cloud services, and platform engineering.
• Hands-on experience with AI inference, model serving, or LLM deployment with inference frameworks (TensorRT, vLLM, TorchServe, Triton).
• Expertise in containerization and orchestration technologies including Kubernetes, Docker, and cloud-native architectures.
• Experience building scalable, high-performance systems with DevOps practices, CI/CD, and IaC.

Responsibilities

• Lead design and implementation of critical platform components for Akamai Inference Cloud.
• Drive technical decisions for AI inference workloads.
• Mentor engineers through code reviews and design discussions.
• Implement and optimize containerized AI workloads with hardware-specific optimizations.
• Collaborate across teams to define requirements and ensure operational excellence.

Skills

Distributed systems

Cloud services

Platform engineering

AI inference

Model serving

API design

DevOps

Observability

Education

Bachelor's degree or equivalent

Tools

Kubernetes

Docker

TensorRT

vLLM

TorchServe

Triton

Job description

Akamai Technologies, Inc. is seeking a Senior II Software Engineer Lead to guide the design and delivery of a globally distributed AI inference platform. You will shape architecture, optimize OpenAI-compatible endpoints, and orchestrate workloads across regions while mentoring a team of engineers.

You will master containerized AI workloads, contribute to platform standards, and ensure high performance, reliability, and scalability in a fast-moving edge-cloud environment.