Senior AI Inference Platform Lead – Hybrid/Edge

Akamai Technologies, Inc.; Pierre (SD); Sur place; USD 146 000 - 264 000; Plein temps

Avantages offerts par ce poste

FlexBase program

Résumé du poste

Akamai Technologies is seeking a Senior II Software Engineer Lead to drive the design and implementation of our globally distributed AI inference platform, delivering OpenAI-compatible endpoints while orchestrating inference workloads across regions.

You will mentor engineers, influence technical direction, and ensure delivery of high-quality, scalable solutions with containerized AI workloads and modern DevOps practices.

Qualifications

• 8 years of relevant experience and a Bachelor's degree or its equivalent.
• Demonstrate hands-on experience with AI inference, model serving, or LLM deployment.
• Solid proficiency in distributed systems, cloud services, and platform engineering.

Responsabilités

• Leading the design and implementation of critical platform components for Akamai Inference Cloud, ensuring performance, scalability, and reliability.
• Driving technical decisions for your domain, selecting appropriate tools, frameworks, and approaches for AI inference workloads.
• Mentoring and guiding engineers on the team through code reviews, design discussions, and technical problem-solving.
• Implementing and optimizing containerized AI workloads with hardware-specific optimizations and integrating inference frameworks at scale.
• Collaborating across teams to define technical requirements, contribute to platform standards, and ensure operational excellence.

Connaissances

Distributed systems

Cloud services

Platform engineering

AI inference

Leadership

REST/gRPC

Monitoring & debugging

Formation

Bachelor's degree or equivalent

Outils

Kubernetes

Docker

TensorRT

vLLM

TorchServe

Triton

Cloud-native architectures

Description du poste

Akamai Technologies is seeking a Senior II Software Engineer Lead to drive the design and implementation of our globally distributed AI inference platform, delivering OpenAI-compatible endpoints while orchestrating inference workloads across regions.

You will mentor engineers, influence technical direction, and ensure delivery of high-quality, scalable solutions with containerized AI workloads and modern DevOps practices.