Overview
Do you enjoy solving complex reliability challenges for cutting-edge technology? Do you have a passion for automation and building systems that scale?
Join the Akamai Inference Cloud Team. The Akamai Inference Cloud team is part of Akamai's Cloud Technology Group. We design, implement, deploy and operate AI platforms that enable customers to run inference models and developers to create AI applications with unmatched performance, compliance, and economics.
Responsibilities
- As a Site Reliability Engineer, you will be responsible for building and maintaining observability for AI workloads, including telemetry, dashboards, alerts, SLO/SLI tracking, and driving improvements when targets are missed.
- Write automation and tooling to reduce operational toil, improve deployment safety, and accelerate incident response.
- Integrate AI workloads into Akamai's existing incident management processes, build runbooks, participate in on-call rotations, and conduct blameless post-mortems.
- Build and maintain CI/CD integrations, deployment safety checks, and rollback automation.
- Collaborate with product engineering teams to improve reliability, contribute to architecture decisions, and ensure operational readiness for product releases.
- Contribute to capacity planning, autoscaling configuration, and workload scheduling for AI compute infrastructure.
What You Will Love / Qualifications
- Demonstrate expertise in SRE, infrastructure, or platform engineering, managing large-scale distributed systems with extensive operational experience.
- Demonstrate expertise in Kubernetes and large-scale containerization systems.
- Define SLOs and work with observability tools like Prometheus, Grafana, and distributed tracing to enhance system monitoring.
- Demonstrate proficiency in Python or Go for automation, CI/CD pipelines, deployment safety, and infrastructure-as-code like Terraform.
- Interest in or experience with AI/ML infrastructure, model serving, or GPU workloads.
- Resolve issues independently while maintaining accountability throughout the process.
- Demonstrate accountability for reliability, develop automation and monitoring, and collaborate effectively with an engineering team unfamiliar with SRE practices.