Remote AI Inference SRE II

Devopsroles

United States

Hybrid

USD 95,000 - 171,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Flexible working

Job summary

Akamai is seeking a Site Reliability Engineer II for the Inference Cloud team in the US. The role focuses on building reliable AI platforms, automating operations, and maintaining observability for scalable AI workloads.

You will develop dashboards, improve incident response, and contribute to CI/CD and infrastructure as code, while growing your expertise in AI infrastructure and distributed systems.

Qualifications

  • 2+ years of Site Reliability Engineering experience.
  • Proficient in Python or Go for automation.

Responsibilities

  • Build and maintain dashboards, alerts, and monitoring for inference workloads.
  • Write automation and tooling in Python or Go to reduce toil.
  • Develop and improve runbooks for inference operations.
  • Contribute to SLO tracking and reporting.
  • Support CI/CD pipeline maintenance and rollback procedures.
  • Collaborate with product engineering to troubleshoot complex issues across the stack.
  • Participate in on-call rotations and post-mortems.

Skills

Linux
Automation
Python
Go
SRE practices
Kubernetes
Monitoring
Prometheus
Grafana
CI/CD

Education

Bachelor's Degree or equivalent experience

Tools

Kubernetes
Prometheus
Grafana
Terraform
SaltStack

Job description

Akamai is seeking a Site Reliability Engineer II for the Inference Cloud team in the US. The role focuses on building reliable AI platforms, automating operations, and maintaining observability for scalable AI workloads.

You will develop dashboards, improve incident response, and contribute to CI/CD and infrastructure as code, while growing your expertise in AI infrastructure and distributed systems.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Site Reliability Engineer - AI-Driven Cloud & Edge
Site Reliability Engineer - AI-Driven Cloud & Edge

Devopsroles • United States

Hybrid
USD 76,000 - 136,000
Health insurance
401K savings plan
Paid time off
+3
Remote SRE II: Automation, Monitoring & Reliability
Remote SRE II: Automation, Monitoring & Reliability

Akamai • Cambridge (MA)

On-site
USD 111,000 - 171,000
Health benefits
401K savings plan
Employee stock purchase plan (ESPP)
+1
SRE II: Cloud Reliability & Automation Engineer (Hybrid)
SRE II: Cloud Reliability & Automation Engineer (Hybrid)

Devopsroles • United States

Hybrid
USD 95,000 - 171,000
Health benefits
Flexible work options
FE Site Reliability Engineer II Fa Extu Saasfaprod1 · Remote · US · Site Reliability $95,000–$171,000 6mo ago
FE Site Reliability Engineer II Fa Extu Saasfaprod1 · Remote · US · Site Reliability $95,000–$171,000 6mo ago

Devopsroles • United States

Hybrid
USD 95,000 - 171,000
Flexible working
SRE: AI Inference Platform & ML Systems
SRE: AI Inference Platform & ML Systems

Cohere • San Francisco (CA)

Hybrid
USD 120,000 - 150,000
Open and inclusive culture
Weekly lunch stipend
Full health and dental benefits
+4
Senior AI Platform SRE: Scale Cloud Infra & Kubernetes
Senior AI Platform SRE: Scale Cloud Infra & Kubernetes

GCS Recruitment • Mount Laurel Township (NJ)

On-site
USD 110,000 - 170,000
Senior AI Infra Engineer - SRE for Inference (Equity)
Senior AI Infra Engineer - SRE for Inference (Equity)

Google • Sunnyvale (CA)

On-site
USD 200,000 - 280,000
Bonus
Equity
Benefits
Senior SRE: AI Compute, Kubernetes & Observability
Senior SRE: AI Compute, Kubernetes & Observability

itMatch • United States

Remote
USD 140,000 - 190,000
Health benefits
Financial planning
Family benefits
+2
SRE, AI Inference Platform | High-Impact Cloud Ops
SRE, AI Inference Platform | High-Impact Cloud Ops

Alibaba Group • Bellevue (WA)

On-site
USD 133,000 - 220,000
Health insurance
401(k)
Paid holidays
+2
Senior SRE: AI Inference Platform - Remote
Senior SRE: AI Inference Platform - Remote

Jaide Health • San Francisco (CA)

On-site
USD 120,000 - 160,000
An open and inclusive culture and work environment
Weekly lunch stipend, in-office lunches & snacks
Full health and dental benefits
+2