GenAI Chatbot Scientist | Optimize & Evaluate AI

1UPPLY; Utrecht; Hybrid; EUR 60,000 - 90,000; Full time

Job summary

1UPPLY in Utrecht is seeking a Data Scientist (Medior–Senior) focused on GenAI and chatbot improvements. You’ll work with data, engineering and product to analyze chatbot behavior and implement meaningful enhancements.

You will explore retrieval, generation and reasoning loops, tool calling and related GenAI capabilities, design evaluation frameworks and translate needs into concrete technical changes. The role is hybrid, with Thursdays in the office at Winthontlaan, Utrecht.

Qualifications

• Strong analytical mindset and passion for understanding AI system behaviour.
• Strong understanding of GenAI systems and experience with LLM-based applications.
• Experience with retrieval-augmented systems.
• Understanding of prompts, context windows, retrieval and grounding.
• Ability to evaluate output quality and explain effectiveness.
• Familiarity with API integrations, batch synchronisation, and structured and unstructured data.
• Ability to collaborate with engineers and troubleshoot data flows.
• Ability to design evaluation frameworks beyond traditional ML metrics.
• Understanding of functional context and user behaviour.
• Clear communication with engineers, product managers and stakeholders.

Responsibilities

• Analyse chatbot outputs and identify improvements with the greatest impact.
• Diagnose context gaps and determine what additional information agents need.
• Work with product managers and engineers to define criteria for evaluating agent performance.
• Partner with use-case teams and stakeholders to understand real-world scenarios and turn feedback into improvements.
• Improve retrieval mechanisms, data structuring and the onboarding of contextual sources.
• Design evaluation frameworks that support rapid, large-scale experimentation and continuous innovation.
• Translate functional requirements into actionable technical improvements.

Skills

GenAI systems

LLM-based apps

Retrieval-augmented systems

Prompts and context

Evaluation frameworks

API integrations

Data structuring

Cross-functional collaboration

Problem solving

Job description

1UPPLY in Utrecht is seeking a Data Scientist (Medior–Senior) focused on GenAI and chatbot improvements. You’ll work with data, engineering and product to analyze chatbot behavior and implement meaningful enhancements.

You will explore retrieval, generation and reasoning loops, tool calling and related GenAI capabilities, design evaluation frameworks and translate needs into concrete technical changes. The role is hybrid, with Thursdays in the office at Winthontlaan, Utrecht.