Staff Site Reliability Engineer — AI Platform

Academic Key; Amsterdam; Hybrid; EUR 110,000 - 145,000; Full time

Benefits offered by this job

Hybrid onboarding

Relocation support

Health insurance

Professional development budget

Flexible benefits

Hybrid work

Free meals and snacks

Annual offsites

Job summary

Manychat in Amsterdam, Netherlands seeks a Staff Site Reliability Engineer to own the reliability, performance, and cost of our AI platform infrastructure, including AI Gateway and inference services. You’ll work on deploying resilient, scalable systems with LLM integrations.

You will shape SRE practices at scale, design observability, drive FinOps, and mentor teams as we expand AI features with providers like Bedrock and OpenAI.

Qualifications

• 5+ years in SRE / platform / infra engineering.
• Production ownership at scale with AI/LLM workloads.
• Hands-on with cloud-native tech: AWS, Kubernetes, Terraform.
• Strong observability and SLO definition.
• Cost optimization and FinOps experience.

Responsibilities

• Own reliability and performance of AI infrastructure including AI Gateway and inference services.
• Integrate with Bedrock, Azure OpenAI and other providers.
• Design and evolve AI Gateway routing, failover, rate limiting, caching, guardrails.
• Build observability: latency/throughput/error SLOs per model/provider; token metrics.
• Drive cost optimization and FinOps for AI workloads.
• Run capacity planning and incident response; write runbooks and postmortems.
• Scale AI expertise across the org; set standards and coach teams.

Skills

Site reliability

Cloud-native

AWS

Kubernetes

Terraform IaC

Observability

Cost optimization

Tools

Prometheus

Grafana

OpenTelemetry

LLM providers

AWS

Job description

Staff Site Reliability Engineer — AI Platform

Manychat · Amsterdam, Netherlands

Abroad Amsterdam, Netherlands Full Time

WHO WE ARE

Creating content that resonates is great — turning that attention into growth is even better. That's what Manychat does. Our AI-powered automations help creators and brands engage with audiences across Instagram, Messenger, WhatsApp, and TikTok — at the right moment, with the right message, minus the manual work. We're 400+ people across three continents behind the leading platform for conversational growth, with AI skills shaping how we build, how we work, and how we grow.

WHO WE’RE LOOKING FOR

Want to shape an AI platform's architecture from day one, instead of just maintaining what someone else built? Manychat runs AI features for businesses worldwide, and we're hiring an SRE to own the reliability, performance, and cost of that AI infrastructure, and to raise the bar for how our whole engineering org builds on LLMs. This isn't a classical SRE role with a bit of AI sprinkled on top. We need someone AI-native: you already understand how modern LLM systems behave in production, things like token throughput, provider rate limits, degraded model quality, and inference latency tails, and you treat all of that as a first-class reliability concern, not an afterthought.

WHAT YOU'LL DO

Own reliability and performance of our AI infrastructure: AI Gateway, inference services, and integrations with Amazon Bedrock, Azure OpenAI, and other LLM providers. Design and evolve the AI Gateway: routing, failover between providers, rate limiting, caching, and guardrails. Build observability for AI systems: latency/throughput/error SLOs per model and provider, token-level metrics, quality and drift signals. Drive cost optimization and FinOps for AI workloads: per-feature cost visibility, model right-sizing, caching strategies, provider mix. Run capacity planning and incident response for inference services; write and improve runbooks and postmortems. Scale AI expertise across the org: set standards, review designs, and coach teams shipping LLM-backed features.

TO SHINE IN THIS ROLE

You’ll need: 5+ years in SRE / platform / infrastructure engineering, including production ownership at significant scale. Hands-on experience operating LLM-backed systems in production: provider APIs (Bedrock, OpenAI, Anthropic, or similar), inference pipelines, self-hosted or managed model serving. Deep cloud-native background: AWS, Kubernetes, Terraform/IaC, CI/CD. Strong observability practice (Prometheus/Grafana, OpenTelemetry, or equivalent) and experience defining SLOs for non-deterministic systems. Proven cost-optimization work: you can show where you cut cloud or inference spend and how you made cost visible. Staff-level influence: you've set technical direction beyond your own team and brought others along. It would be great if you have: Experience building or operating an LLM gateway/proxy (e.g., LiteLLM, Kong AI Gateway, custom). Experience with GPU workload optimization, quantization, or serving frameworks (vLLM, TGI, Triton). Experience with eval pipelines and quality monitoring for LLM outputs.

WHAT WE OFFER

We care deeply about your growth, well-being, and comfort: Hybrid onboarding to start work remotely and relocation support for you and your family. Comprehensive health insurance for both you and your family. Professional development budget for conference tickets, online courses, and other relevant resources to help you grow. Flexible benefits package: no one-size-fits-all perks here. You get a budget and you decide where it goes, from health and wellbeing to family and setting up your home office. Hybrid work and generous, flexible time off — planned with your team, not rationed by a rigid quota. In-office perks, including free meals and snacks. Company-funded sport activities, annual offsites and team-building events. AI isn't a perk here — it's how we work. Claude, OpenAI, and more are on by default from day one, and we back teams in adopting whatever makes them faster.

Manychat is an Equal Opportunity Employer. We’re committed to building a diverse and inclusive team. We do not discriminate against qualified employees or applicants because of race, color, religion, gender identity, sex, sexual preference, sexual id