Dev Ops Engineer C

Impact Vandaag; Amsterdam; Remote; EUR 59,000 - 71,000; Full time

Benefits offered by this job

Hoog salaris

Vakantiegeld 8%

Pensioenopbouw

Reiskostenvergoeding

Zorgeloze naleving Wet DBA

Job summary

Impact Vandaag biedt een uitdagende positie als AI Engineer - RAG Platform. Je werkt aan Rabobank's interne RAG platform en verbetert de prestaties en betrouwbaarheid van de retrieval- en verwerkingsteams in een productie-omgeving.

Je werkt nauw samen met software engineers, data scientists en productmanagers en ontwikkelt automatiseringskaders die productieoplossingen leveren met meetbare bedrijfswaarde. Engelse communicatie is vereist en je werkt op kantoor.

Qualifications

• Master's degree of equivalent in Data Science, AI, CS, Math or related field.
• 3+ years ervaring in machine learning, applied AI of data science.
• Aantoonbare ervaring met productie-RAG systemen of geavanceerde retrieval-gebaseerde AI oplossingen.
• Ervaring met evaluatiemethodologieën en kwaliteitsmetrics.
• Sterk in het omzetten van analyses naar geautomatiseerde productieoplossingen.

Responsibilities

• Verbeteren van retrieval-prestaties, antwoordkwaliteit en gebruikerservaring door middel van experimenten en analyse.
• Ontwikkelen van geautomatiseerde kaders die RAG-kwaliteit meten en regressies identificeren.
• Vertalen van data-analyse en experimentresultaten naar schaalbare engineering-oplossingen.
• Definiëren en monitoren van kwaliteitsmetrics voor elke release.

Skills

RAG

LLMs

Python

Databricks

Evaluation frameworks

Embedding models

Prompt optimization

Data pipelines

CI/CD

Azure

Fine-tuning

Retrieval systems

AI observability

Production AI

Education

Master’s degree in Data Science / AI

Tools

Databricks

Azure

Python

Job description

## Dev Ops Engineer CRabobankVan Baerlestraat 102-106, 1071 BC Amsterdam, Nederland, Noord-HollandStartdatum 26 - 10 - 2026Einddatum 30 - 08 - 20275.823,40 p/m 37,33 p/u36 uur p/w11 maandenUtrechtICTInformatiemanagementPublicatiedatum: 23 oktober 2026Optie tot verlenging: Niets over bekend.Werkplek: Alleen op kantoor | Geen verdere informatie.Opleidingsniveau: WOWerkervaring: Senior### Hoe ga jij impact maken?**Zoekopdracht** **PosID : P\\_00211506** **Language : English mandatory** **Description Vacancy :****AI Engineer - RAG Platform****Job description**Want to improve one of Rabobank's most strategic AI platforms through data-driven experimentation and measurable model improvements?**You & your role**As an AI Engineer - RAG Platform, you are responsible for continuously improving the quality, accuracy and effectiveness of Rabobank's internal Retrieval-Augmented Generation (RAG) platform.You work at the intersection of Information Retrieval, Data Science and Software Engineering. Rather than building AI applications or platform infrastructure, your primary responsibility is improving the performance of the RAG system itself.The RAG platform serves thousands of users across Rabobank and acts as a foundation for multiple AI-powered products. Your focus is understanding where and why the system underperforms, designing experiments to validate improvements and translating insights into measurable production outcomes.You contribute across the entire improvement lifecycle, from failure analysis and hypothesis generation to evaluation, implementation and monitoring. You leverage user feedback, retrieval metrics, evaluation datasets and production telemetry to continuously increase answer quality and user trust.This role is designed for a highly analytical and hands-on specialist who wants to deepen their expertise in retrieval systems, evaluation methodologies and applied AI rather than moving towards people management or generic product development.You will work closely with Software Engineers, Platform Engineers, Data Scientists and Product Managers, while acting as the driving force behind the continuous improvement of Rabobank's RAG capabilities.**Examples of what you will work on*** Investigating why certain user questions produce lower-quality answers and identifying the underlying retrieval or grounding issues.* Improving our automated evaluation framework to measure retrieval quality, answer quality and user satisfaction.* Running large-scale experiments to determine the impact of different chunking, embedding and retrieval strategies.* Analyzing user interactions and system performance data in Databricks to uncover improvement opportunities.* Building feedback loops that continuously identify weak responses and feed insights back into the development process.* Defining and monitoring quality metrics that ensure every release results in measurable model improvements.**Key responsibilities*** Improve retrieval performance, answer quality and overall user experience through experimentation, analysis and optimization.* Develop automated frameworks that measure RAG quality, identify regressions and provide actionable insights for future improvements.* Translate data analysis and experimentation results into scalable, maintainable engineering solutions that deliver measurable business value.### Eisen* Master's degree or equivalent academic level in Data Science, Artificial Intelligence, Computer Science, Mathematics, Statistics or a related field.* At least 3 years of relevant experience in machine learning, applied AI or data science.* Demonstrable experience improving production-grade RAG systems or advanced retrieval-based AI solutions.* Experience designing evaluation methodologies and quality metrics.* Strong track record of converting analyses into automated production solutions.* Experience working with large datasets and complex distributed environments.* Ability to communicate findings and recommendations to both technical and non-technical stakeholders.* Proficiency in English, both written and spoken.### Wensen en competenties### Wensen* Retrieval-Augmented Generation (RAG)* Large Language Models (LLMs)* Python* Databricks* Evaluation frameworks for GenAI systems* Embedding models* Prompt optimization* Data pipelines and workflow automation* CI/CD practices* Azure* Experience with fine-tuning language models.* Experience with ranking and retrieval systems.* Experience with AI observability and monitoring.* Experience working with large-scale production AI platforms.* Knowledge of synthetic evaluation datasets and benchmark creation.### Competenties* Enjoys solving hard problems and is driven by measurable outcomes.* Equally comfortable discussing statistical significance, retrieval metrics and system architecture.* Takes ownership of results rather than activities.* Naturally curious, analytical and passionate about improving complex systems.### Organisatie & Team**Facts & figures*** 36 hours per week.* A strategic AI platform used across Rabobank.* Working on a production AI system where quality improvements directly impact thousands of users.* Part of a multidisciplinary team combining engineering, product and AI expertise.**Together we achieve more than alone**The RAG platform is not a research project. It is a production product that must continuously improve.You will join a team of experienced engineers who are building and operating critical AI capabilities within Rabobank. Success in this role comes from combining scientific rigor with engineering excellence. We value people who challenge assumptions, validate ideas through data and continuously raise the quality bar.### Deze voorwaarden bieden we jouAls ervaren specialist bieden wij jou passende voorwaarden.Hoog salaris bij Impact Vandaag. Het bruto salaris is € 5.823,40 p/m o.b.v. € 37,33 p/u en 36 uur per week.Transparante pro-forma berekening.Vakantiegeld van 8% en een vast aantal vakantiedagen per jaar (fulltime basis).Zorgeloze naleving van de Wet DBA.Doorbetaling bij ziekte volgens CAO.Een contract voor de duur van de opdracht, met optie tot verlenging afhankelijk van de functie en organisatie.Pensioenopbouw via de regeling voor uitzendkrachten.Reiskostenvergoeding afhankelijk van de functie en organisatie.Naast de contractuele voordelen, bieden we extra dienstverlening als je voor Impact Vandaag kiest. Benieuwd naar onze dienstverlening?Hoe werkt hetAangenomen via Impact Vandaag? Dan doneren wij €250 aan een goed doel dat jij kiest. Lees meer### Stappenplan voor deze vacature1Solliciteren2Kennismaken3Voorbereiding gesprek4UitslagVind je deze vacature interessant? Klik op solliciteren en stuur je cv mee. Binnen 48 uur neemt één van onze adviseurs contact met je op. We kijken daarbij:* • Of jouw profiel geschikt is voor de functie op basis van de gevraagde eisen, wensen en competenties.* • Of je past bij de organisatie.Past de vacature bij jouw profiel? Dan neemt onze Opdracht Adviseur contact op over jouw sollicitatie en cv. Je kunt je contactvoorkeuren doorgeven in jouw profiel.