RAG Platform AI Engineer - Hybrid (Utrecht)

1UPPLY; Utrecht; Hybrid; EUR 85,000 - 125,000; Full time

Job summary

1UPPLY is seeking an AI Engineer – RAG Platform in Utrecht with a focus on improving the retrieval quality and user experience of a production RAG system. You will work at the intersection of information retrieval, data science and software engineering, translating analyses into production improvements.

The role requires a master’s degree and at least 3 years in ML/AI, with strong Python and Databricks skills.

Qualifications

• Master’s degree in Data Science, Artificial Intelligence, Computer Science, Mathematics, Statistics or related field.
• At least 3 years of relevant experience in machine learning, applied AI or data science.
• Demonstrable experience improving production-grade RAG systems or advanced retrieval-based AI solutions.
• Experience designing evaluation methodologies and quality metrics.
• Strong track record of turning analysis into automated production solutions.
• Experience working with large datasets and complex distributed environments.
• Ability to communicate findings and recommendations to technical and non-technical stakeholders.

Responsibilities

• Improve retrieval performance, answer quality and user experience through analysis, experimentation and optimization.
• Investigate low-quality answers and identify retrieval or grounding issues.
• Develop automated evaluation frameworks to measure retrieval quality, answer quality and user satisfaction.
• Run large-scale experiments on chunking, embedding and retrieval strategies.
• Analyze user interactions and system performance data to identify improvement opportunities.
• Build feedback loops that identify weak responses and inform ongoing development.
• Define and monitor quality metrics to measure improvements and identify regressions.
• Turn analysis and experimentation into scalable, maintainable production solutions.

Skills

RAG systems

LLMs

Python

Databricks

Evaluation metrics

Prompt optimization

Embedding models

Data pipelines

CI/CD

Azure

Experimentation

Education

Master’s degree in Data Science / AI / CS

Tools

Databricks

Azure

CI/CD tools

Python tooling

Job description

1UPPLY is seeking an AI Engineer – RAG Platform in Utrecht with a focus on improving the retrieval quality and user experience of a production RAG system. You will work at the intersection of information retrieval, data science and software engineering, translating analyses into production improvements.

The role requires a master’s degree and at least 3 years in ML/AI, with strong Python and Databricks skills.