AI Data Scientist – Production Agents (Hybrid)

Just Eat Takeaway.com; Amsterdam; Hybrid; EUR 70,000 - 110,000; Full time

Job summary

Just Eat Takeaway.com is seeking a Data Scientist – AI Engineering (Mid-level) in Amsterdam/ Berlin to design, evaluate, and monitor LLM-powered agents across markets. You’ll work with Product, Backend, Operations, and fellow Data Scientists to ensure reliable, safe, and measurable improvements in real‑time customer interactions.

The role blends data analysis, tool use, and software engineering to ship agent changes safely in a hybrid environment with three days in the office and two remote days.

Qualifications

• Hands-on experience building and shipping user-facing AI agents in production.
• Experience with agent evaluation: datasets, metrics, and online/offline experiments.
• Experience with observability: tracing, dashboards, and alerts for AI agents.
• Experience with agent frameworks and multi-agent designs.
• Strong Python and SQL; good software engineering habits (typing, linting, tests).
• Solid data science foundation: statistics and experiment design.

Responsibilities

• Agent Development: build and improve agent components, prompts, workflows, and handovers to humans.
• Agent Evaluation: create evaluation suites, run offline experiments, compare prompts/models, guide decisions.
• Observability & Monitoring: instrument agents, build dashboards, and monitor quality/cost/latency.
• Production Standards: ship changes safely with tests, code review, and version control.
• Data Analysis: analyze large volumes of conversations using SQL/Python and define metrics.
• Actionable Insights: translate results into clear recommendations with visuals.
• Cross-functional Collaboration: work with Backend, Ops, Product to expand agent capabilities.
• Process Improvement: identify and automate evaluation, testing, and release workflows.

Skills

Python

SQL

LLM-based systems

Agent development

Agent evaluation

Observability

Docker/Kubernetes

Data analysis

Tools

OpenTelemetry

Datadog

Job description

Just Eat Takeaway.com is seeking a Data Scientist – AI Engineering (Mid-level) in Amsterdam/ Berlin to design, evaluate, and monitor LLM-powered agents across markets. You’ll work with Product, Backend, Operations, and fellow Data Scientists to ensure reliable, safe, and measurable improvements in real‑time customer interactions.

The role blends data analysis, tool use, and software engineering to ship agent changes safely in a hybrid environment with three days in the office and two remote days.