Senior AI Inference Platform Lead

Akamai Technologies, Inc.

Lansing (MI)

Hybrid

USD 146,000 - 264,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Akamai is seeking a Senior II Software Engineer Lead to drive design and implementation of core Akamai Inference Cloud components. You will work hands-on to scale AI inference workloads across regions, while mentoring engineers and guiding technical directions.

The role requires deep expertise in distributed systems, Kubernetes/Docker, and modern DevOps practices, with a focus on performance, reliability, and compliance. This is a high-visibility leadership role within our edge AI platform team.

Qualifications

  • 8 years of relevant experience and a Bachelor's degree or its equivalent.
  • Hands-on experience with AI inference, model serving, or LLM deployment.
  • Proficiency in distributed systems, cloud services, and platform engineering.
  • Experience with inference frameworks: TensorRT, vLLM, TorchServe, Triton.
  • CI/CD and infrastructure-as-code experience.

Responsibilities

  • Lead design and implementation of critical platform components for Akamai Inference Cloud.
  • Drive technical decisions for AI inference workloads and scaling across regions.
  • Mentor engineers through code reviews and design discussions.
  • Implement and optimize containerized AI workloads with hardware tuning.
  • Collaborate across teams to define requirements and operational standards.

Skills

Distributed systems
Cloud services
Platform engineering
AI inference
Kubernetes
Docker
CI/CD
Infrastructure as code
API design (REST/gRPC)
GPU infrastructure

Education

Bachelor's degree or equivalent

Tools

Kubernetes
Docker
Cloud-native architectures

Job description

Akamai is seeking a Senior II Software Engineer Lead to drive design and implementation of core Akamai Inference Cloud components. You will work hands-on to scale AI inference workloads across regions, while mentoring engineers and guiding technical directions.

The role requires deep expertise in distributed systems, Kubernetes/Docker, and modern DevOps practices, with a focus on performance, reliability, and compliance. This is a high-visibility leadership role within our edge AI platform team.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Senior AI Inference Platform Lead
Remote Senior AI Inference Platform Lead

Akamai • Cambridge (MA)

Remote
USD 146,000 - 264,000
Remote Senior AI Inference Platform Lead
Remote Senior AI Inference Platform Lead

Akamai Career Site • United States

Remote
USD 146,000 - 264,000
Senior AI Platform Lead - Edge & Cloud (Remote)
Senior AI Platform Lead - Edge & Cloud (Remote)

Akamai Technologies, Inc. • Cambridge (MA)

On-site
USD 146,000 - 264,000
Healthcare
401K savings
Paid time off
+3
Senior AI Inference Cloud Lead (Remote)
Senior AI Inference Cloud Lead (Remote)

Akamai Technologies • United States

Remote
USD 146,000 - 264,000
Healthcare
401K savings plan
Paid time off
+4
Senior II Software Engineer Lead
Senior II Software Engineer Lead

Akamai • Cambridge (MA)

Remote
USD 146,000 - 264,000
Senior II Software Engineer Lead
Senior II Software Engineer Lead

Akamai Career Site • United States

Remote
USD 146,000 - 264,000
Machine Learning Senior II Software Engineer Lead
Machine Learning Senior II Software Engineer Lead

Akamai Technologies • United States

Remote
USD 146,000 - 264,000
Healthcare
401K savings plan
Paid time off
+4
Senior AI Platform Program Manager (Cloud/ML Infra)
Senior AI Platform Program Manager (Cloud/ML Infra)

Akamai Technologies, Inc. • Little Rock (AR)

On-site
USD 120,000 - 180,000
Senior Director, AI Infrastructure & Inference - Remote
Senior Director, AI Infrastructure & Inference - Remote

Akamai • United States

Remote
USD 191,000 - 343,000
Health benefits
401K
Paid time off
+2
Senior Director, AI Infrastructure & Inference (Remote)
Senior Director, AI Infrastructure & Inference (Remote)

Akamai • Cambridge (MA)

Hybrid
USD 191,000 - 343,000
FlexBase program
Health benefits
401K savings plan
+1