Senior AI Platform Lead — Edge & Inference Cloud

Akamai Technologies, Inc.; Bismarck (ND); On-site; USD 146,000 - 264,000; Full time

Benefits offered by this job

FlexBase program

Health benefits

Job summary

Akamai Technologies, Inc. is seeking a Senior II Software Engineer Lead to drive the design and implementation of AI inference platform components. You will build OpenAI-compatible endpoints and coordinate inference workloads across regions while mentoring engineers and guiding technical direction.

The role requires hands-on experience with AI inference, model serving, and modern container orchestration. You will collaborate with cross-functional teams to ensure performance, security, and

Qualifications

• 8 years of relevant experience and a Bachelor's degree or its equivalent.
• Solid proficiency in distributed systems, cloud services, and platform engineering.
• Hands-on experience with AI inference, model serving, or LLM deployment with working knowledge of inference frameworks (TensorRT, vLLM, TorchServe, Triton).
• Expertise in containerization and orchestration technologies including Kubernetes, Docker, and cloud-native architectures.
• Experience building scalable, high-performance systems with DevOps practices, CI/CD pipelines, and infrastructure-as-code.
• Solid technical leadership through mentoring, code quality advocacy, and driving technical solutions.
• Familiarity with API design and development (REST/gRPC), GPU infrastructure and hardware acceleration.
• Knowledge of observability, monitoring, and debugging distributed systems.

Responsibilities

• Lead design and implementation of critical Akamai Inference Cloud components with performance, scalability, reliability.
• Drive technical decisions for AI inference workloads with appropriate tooling and approaches.
• Mentor engineers through code reviews, design discussions, and problem-solving.
• Implement and optimize containerized AI workloads with hardware-specific optimizations and scalable inference frameworks.
• Collaborate across teams to define requirements, contribute to platform standards, and ensure operational excellence.

Skills

Distributed systems

Cloud services

Platform engineering

AI inference

LLM deployment

Kubernetes

Docker

CI/CD

Observability

API design

Education

Bachelor's degree or equivalent

Tools

TensorRT

vLLM

TorchServe

Triton

Kubernetes

Docker

Job description

Akamai Technologies, Inc. is seeking a Senior II Software Engineer Lead to drive the design and implementation of AI inference platform components. You will build OpenAI-compatible endpoints and coordinate inference workloads across regions while mentoring engineers and guiding technical direction.

The role requires hands-on experience with AI inference, model serving, and modern container orchestration. You will collaborate with cross-functional teams to ensure performance, security, and