Conversational AI Engineer - Data & Evaluation Specialist

Everience Benelux; Utrecht; On-site; EUR 70,000 - 110,000; Full time

Job summary

Everience Benelux in the Netherlands seeks an AI Engineer to strengthen its Conversational AI teams. The consultant will prepare enterprise data and knowledge for AI assistants, implementing evaluation frameworks across single-turn, multi-turn, simulated, and agentic scenarios to ensure accurate, grounded support for advisors.

You will build data pipelines, maintain Databricks workflows, and deploy cloud infrastructure using IaC (Azure Bicep) and CI/CD pipelines. English fluency is required.

Qualifications

• A strong engineering and data-quality mindset with an affinity for Agile development.
• A proactive, hands-on approach to solving complex AI-quality and cloud-engineering challenges.
• Strong critical thinking, ownership, and accountability for production-ready solutions.
• Excellent communication skills and a customer-centric attitude.
• A relevant HBO or university degree and fluency in English.
• Strong proficiency in Python and experience with data engineering and automated testing.
• Hands-on experience with Azure, Databricks, DevOps, CI/CD, and Infrastructure as Code, preferably Bicep.
• Experience building data pipelines and preparing structured and unstructured enterprise data for AI knowledge bases and RAG applications.
• Experience applying evaluation methods to advanced chatbots, including multi-turn, simulated, and agentic interactions.
• Familiarity with Context Engineering, Agentic AI, Function Calling, retrieval strategies, and tool use.

Responsibilities

• Collaborate within a scrum team to prepare, structure, enrich, and validate enterprise data for AI knowledge bases and AI Chatbots.
• Build and maintain data pipelines in Databricks to process structured and unstructured data for AI knowledge bases.
• Apply evaluation frameworks to test advanced chatbots across single-turn, multi-turn, simulation-based, and agentic scenarios.
• Prepare, clean, transform, and enrich source data to improve the quality and reliability of information used by AI assistants.
• Create and maintain evaluation datasets covering realistic conversations, complex cases, edge cases, and multi-step workflows.
• Implement automated testing, monitoring, and quality gates for changes to data, prompts, models, retrieval, and orchestration.
• Deploy and manage cloud infrastructure using Infrastructure as Code, particularly Azure Bicep and CI/CD pipelines.
• Analyse evaluation results and translate findings into improvements across knowledge, retrieval, prompts, tools, and application logic.

Skills

Python

Agile development

Critical thinking

Ownership

Communication

English fluency

Education

Bachelor's or HBO degree

Tools

Azure

Databricks

DevOps

CI/CD

Infrastructure as Code

Bicep

Job description

Everience Benelux in the Netherlands seeks an AI Engineer to strengthen its Conversational AI teams. The consultant will prepare enterprise data and knowledge for AI assistants, implementing evaluation frameworks across single-turn, multi-turn, simulated, and agentic scenarios to ensure accurate, grounded support for advisors.

You will build data pipelines, maintain Databricks workflows, and deploy cloud infrastructure using IaC (Azure Bicep) and CI/CD pipelines. English fluency is required.