Data Scientist/AI Engineer

Vacaturebank; Amsterdam; Hybrid; EUR 70,000 - 110,000; Full time

Job summary

Just Eat Takeaway.com is seeking a Data Scientist – AI Engineering (Mid-level) to join the Logistics Tech team in Amsterdam/ Berlin. This hybrid role involves developing production-grade AI agents, evaluating their performance, and monitoring systems across multiple markets.

You will collaborate with Product, Backend, and Operations to push intelligent agent capabilities forward. You’ll design and implement prompts, tool integrations, and evaluation harnesses, while ensuring reliability,

Qualifications

• Hands-on experience delivering user-facing AI agents in production.
• Experience with evaluating agents using datasets and metrics.
• Background in observability: tracing, logging, dashboards.
• Strong Python and SQL, solid software engineering habits.

Responsibilities

• Agent Development: build and improve prompts, tool use, and human handover.
• Agent Evaluation: create datasets, metrics, offline/online experiments; decide ship vs. don't ship.
• Observability & Monitoring: dashboards, alerts, production traces analysis.

Skills

Python

SQL

LLM-based agents

Agent evaluation

Observability

Data analysis

Communication

Education

Bachelor's degree in a relevant field

Tools

OpenTelemetry

Datadog

Docker

Kubernetes

Job description

Position: Data Scientist – AI Engineering (Mid-level)

Department: Logistics Tech – Data Science & AI

Reporting to: Data Science Manager

Location: Amsterdam, Berlin

Hybrid role: 3 days a week from our office & 2 days working from home

Full/Part time: Full time

Ready for a challenge?

Then Just Eat Takeaway.com might be the place for you. We're a leading global online delivery platform, and our vision is to empower everyday convenience.

Whether it's a Friday-night feast, a post-gym poke bowl, or grabbing some groceries, our tech platform connects tens of millions of customers with hundreds of thousands of restaurant, grocery and convenience partners across the globe.

About this role

As a Data Scientist – AI Engineering, you will help build and run the AI agents that support the people who keep our delivery network moving. These are production, user-facing agents that help users resolve issues and take actions in real time, across multiple markets and languages.

Your mission is to make these agents measurably better and safe to change. You will build, evaluate, and monitor LLM-powered agents end to end: from designing agent behaviour and tools, to building the evaluation harness that tells us whether a change is an improvement, to the observability that tells us how the agent behaves in production. You will work closely with Product, Backend Engineers, Operations colleagues, and the other Data Scientists on the team.

These are some of the key components to the position:

• Agent Development: Build and improve components of our agent systems — prompts and workflows, tool use, and handover to humans. Translate operational requirements into agent behaviour that is reliable and testable.
• Agent Evaluation: Build and maintain evaluation suites for agents: datasets built from real conversations and scenarios, LLM-as-a-judge and deterministic metrics, and end-to-end tests of tool-using agents. Run offline experiments to compare models, prompts, and agent designs, and use the results to make clear ship / don't-ship recommendations. Help move us towards automated and well-grounded online evaluation.
• Observability & Monitoring: Instrument agents with tracing, structured logging, and quality metrics. Build and maintain dashboards and alerts covering quality, latency, cost, and failure modes. Analyse production traces and historical conversations to find regressions and the next best improvement.
• Production Standards: Ship agent changes safely — well-tested Python, code review, version control. Be mindful of production rules, data privacy and security.
• Data Analysis: Use SQL and Python to analyse large volumes of conversation and operational data, define and track quality and business metrics, and quantify the impact of agent changes.
• Actionable Insights: Translate evaluation and monitoring results into clear recommendations for the team and stakeholders, using data visualisation where it helps.
• Cross-functional Collaboration: Work with Backend Engineers, Operations and Product to expand what our agents can do, and contribute to a growing internal community of people building user-facing agents at JET.
• Process Improvement: Spot opportunities to automate evaluation, testing and release workflows, and make contributions to them.

What will you bring to the team?

• Hands-on experience building and shipping user-facing AI agents in production — LLM-based systems that real users interact with, where reliability, latency, safety and graceful handover to humans matter.
• Practical experience with agent evaluation: building evaluation datasets, defining metrics, using LLM-as-a-judge, regression testing agents, and running offline and online experiments to compare prompts, models or agent designs.
• Practical experience with agent observability and monitoring: tracing and debugging multi-step agent runs, defining quality/cost/latency signals, and building dashboards and alerts for LLM systems in production (e.g. OpenTelemetry, Datadog, or similar tooling).
• Experience with agent frameworks (e.g. Google ADK, LangGraph, or similar), tool use / MCP, and multi-step or multi-agent designs.
• Strong Python and SQL; good software engineering habits — typing, linting, unit tests, Git, CI/CD, code review.
• A solid data science foundation: statistics, experiment design, and the ability to reason about whether an observed change is a real improvement.
• Comfortable working independently on well-defined problems, knowing when to ask for guidance, and communicating results clearly to technical and non-technical stakeholders.
• Nice to have: experience with feature flags and staged rollouts, containerised deployments (Docker/Kubernetes).

At JET, this is how we play

Our teams forge connections internally and work with some of the best-known brands on the planet, giving us truly international impact in a dynamic environment.

Being the best at what we do isn't just about delivering on our strategy. It's a competition for something incredibly valuable – our customers' choice. Every time a customer decides where to order, they're picking a side.

At the heart of the JET Customer League are our values and behaviours. They guide every interaction, every decision, every innovation. These are the actions we need to perform consistently and brilliantly, to surpass the competition and earn our customers' loyalty, again and again.

Fun, fast-paced and supportive, the JET culture is about movement, growth, helping one another to succeed and celebrating wins. By truly living our values and embodying our behaviours, we're building a customer-first culture which enables us to stay one step ahead of the competition.

Inclusion, Diversity & Belonging

No matter who you are, what you look like, who you love, or where you are from, you can find your place at Just Eat Takeaway.com. We're committed to creating an inclusive culture, encouraging diversity of people and thinking, in which all employees feel they truly belong and can bring their most colourful selves to work every day.

What else are we delivering?

Want to know more about our JETers, culture or company? Have a look at our career site where you can find people's stories, blogs, podcasts and more JET journeys.