Senior LLM Platform Engineer: Ops, Evaluations & Infra

Datasnipper; Netherlands; On-site; EUR 90,000 - 130,000; Full time

Job summary

Datasnipper in the Netherlands seeks an experienced backend/platform engineer to own the LLM gateway, multi-cloud deployments, and infra-as-code workflows. You will build and maintain a shared AI platform, ensuring reliability, security, and scalability while collaborating with product and ML teams.

You will lead on-call incidents, implement observability with OpenTelemetry and Grafana, and drive cost attribution across providers.

Qualifications

• 5+ years of backend or platform engineering experience.
• Strong production Python experience.
• Experience with cloud infrastructure and IaC (Terraform).
• Experience running shared services in production: on-call, incidents, postmortems, SLOs.
• Experience building or running LLM inference infrastructure with a gateway or routing layer.

Responsibilities

• Own the LLM gateway: routing, provider failover, rate limits, retries, and cost attribution across multiple model providers.
• Deploy, version and deprecate models across clouds, regions and environments, including quota and capacity planning, managed as infrastructure as code.
• Build the shared evaluation platform: versioned datasets, experiment tracking, run and result schemas, reporting, and trace linkage back to the run.
• Own the infrastructure for async and long-running AI workloads.
• Own observability for AI traffic: latency, retries and fallbacks, token usage, cost and errors, per team and per use case.
• Take part in the on-call rotation, run incidents, and close the follow-ups.
• Implement the security and compliance controls the platform is held to: retention, access control, RBAC and SSO.
• Define and maintain clean integration contracts between the platform and the teams that consume it.
• Partner with product and ML engineers to turn their requirements into platform capabilities that are self-service rather than a request queue.

Skills

Python

Observability

On-call

Collaboration

Judgment

Growth mindset

Tools

Terraform

Azure

GCP

OpenTelemetry

Grafana

Job description

Datasnipper in the Netherlands seeks an experienced backend/platform engineer to own the LLM gateway, multi-cloud deployments, and infra-as-code workflows. You will build and maintain a shared AI platform, ensuring reliability, security, and scalability while collaborating with product and ML teams.

You will lead on-call incidents, implement observability with OpenTelemetry and Grafana, and drive cost attribution across providers.