Senior AI Inference Platform Lead

Akamai Technologies, Inc.; Honolulu (HI); Presencial; USD 146.000 - 264.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

FlexBase program

Healthcare

401K savings plan

Parental leave

Descripción de la vacante

Akamai Technologies, Inc. seeks a Senior II Software Engineer Lead to drive design and implementation of AI inference platform components. You will deliver OpenAI-compatible endpoints, orchestrate workloads across regions, and mentor engineers to raise engineering quality.

In this role you lead technical decisions, optimize containerized workloads, and collaborate with cross-team stakeholders to meet reliability and performance goals for edge and cloud deployments.

Formación

• 8 years of relevant experience and a Bachelor's degree or its equivalent.
• Solid proficiency in distributed systems, cloud services, and platform engineering.
• Hands-on experience with AI inference, model serving, or LLM deployment with working knowledge of inference frameworks (TensorRT, vLLM, TorchServe, Triton).
• Expertise in containerization and orchestration technologies including Kubernetes, Docker, and cloud-native architectures.
• Experience building scalable, high-performance systems with DevOps practices, CI/CD pipelines, and infrastructure-as-code.
• Solid technical leadership through mentoring, code quality advocacy, and ability to drive technical solutions for complex problems.
• Familiarity with API design and development (REST/gRPC patterns), GPU infrastructure and hardware acceleration.
• Knowledge of observability, monitoring, and debugging distributed systems.

Responsabilidades

• Leading the design and implementation of critical platform components for Akamai Inference Cloud, ensuring performance, scalability, and reliability
• Driving technical decisions for your domain, selecting appropriate tools, frameworks, and approaches for AI inference workloads
• Mentoring and guiding engineers on the team through code reviews, design discussions, and technical problem-solving
• Implementing and optimizing containerized AI workloads with hardware-specific optimizations and integrating inference frameworks at scale
• Collaborating across teams to define technical requirements, contribute to platform standards, and ensure operational excellence

Conocimientos

Distributed systems

Cloud services

Platform engineering

AI inference

Model serving

LLM deployment

API design

GPU infrastructure

Observability

Educación

Bachelor's degree

Herramientas

Kubernetes

Docker

TensorRT

vLLM

TorchServe

Triton

Descripción del empleo

Akamai Technologies, Inc. seeks a Senior II Software Engineer Lead to drive design and implementation of AI inference platform components. You will deliver OpenAI-compatible endpoints, orchestrate workloads across regions, and mentor engineers to raise engineering quality.

In this role you lead technical decisions, optimize containerized workloads, and collaborate with cross-team stakeholders to meet reliability and performance goals for edge and cloud deployments.