RAG Platform AI Engineer — Data-Driven Optimizer

1UPPLY; Utrecht; Hybrid; EUR 70,000 - 110,000; Full time

Job summary

1UPPLY is seeking an AI Engineer focused on a Retrieval-Augmented Generation platform in Utrecht, Netherlands. You will improve system quality and user trust by analyzing failures, designing experiments and implementing production-ready improvements.

You will work across information retrieval, data science and software engineering to raise answer quality, build automated evaluation and monitoring, and partner with product managers and engineers to deliver measurable outcomes.

Qualifications

• Master’s degree or equivalent in data science, AI, CS, maths or statistics.
• At least 3 years in ML, AI or data science.
• Proven experience improving production-grade RAG or retrieval-based AI.
• Experience designing evaluation methodologies and quality metrics.
• Strong track record turning analysis into automated production solutions.
• Experience with large datasets and distributed environments.
• Excellent written and spoken English.
• Curious, analytical mindset with ownership of outcomes.

Responsibilities

• Improve retrieval performance, answer quality and user experience through analysis and optimization.
• Investigate low-quality answers to identify retrieval or grounding issues.
• Develop automated evaluation frameworks for retrieval and answer quality.
• Run large-scale experiments on chunking, embeddings and retrieval strategies.
• Analyze user interactions and data in Databricks to find improvement opportunities.
• Create feedback loops to feed insights into development.
• Define and monitor quality metrics for measurable release improvements.
• Translate analysis into scalable engineering solutions.
• Collaborate with software, platform, data science and product teams.

Skills

RAG

LLMs

Python

Databricks

Evaluation frameworks

Embedding models

Prompt optimization

Data pipelines

CI/CD

Azure

Education

Master’s degree or equivalent in Data Science / AI / CS

Tools

Databricks

Azure

CI/CD tooling

Job description

1UPPLY is seeking an AI Engineer focused on a Retrieval-Augmented Generation platform in Utrecht, Netherlands. You will improve system quality and user trust by analyzing failures, designing experiments and implementing production-ready improvements.

You will work across information retrieval, data science and software engineering to raise answer quality, build automated evaluation and monitoring, and partner with product managers and engineers to deliver measurable outcomes.