RAG Platform AI Engineer — Optimize Production LLMs (Hybrid)

1UP Training (Netherlands); Utrecht; Hybrid; EUR 70,000 - 100,000; Full time

Job summary

1UP Training in Utrecht is seeking an AI Engineer – RAG Platform to enhance a production Retrieval-Augmented Generation system. You will work at the intersection of information retrieval, data science and software engineering to improve performance and user satisfaction.

The role focuses on experimentation, evaluation, and scalable deployment. Collaboration with software engineers, data scientists and product managers is essential, with a hybrid work setup in the Netherlands.

Qualifications

• Master's degree or equivalent in a related field.
• At least 3 years of relevant experience in ML, AI or data science.
• Proven experience improving production-grade RAG systems or advanced retrieval-based AI solutions.
• Experience designing evaluation methodologies and quality metrics.
• Ability to communicate findings to technical and non-technical stakeholders.
• Experience with large datasets and distributed environments.

Responsibilities

• Improve retrieval performance, answer quality and user experience through analysis, experimentation and optimization.
• Investigate low-quality answers and identify retrieval or grounding issues.
• Develop automated evaluation frameworks to measure retrieval quality and user satisfaction.
• Run large-scale experiments on chunking, embedding and retrieval strategies.
• Analyze user interactions and system performance data to identify opportunities for improvement.
• Build feedback loops that identify weak responses and inform ongoing development.
• Define and monitor quality metrics to measure improvements and identify regressions.
• Turn analysis and experimentation into scalable, production-ready solutions.

Skills

RAG systems

Python

Databricks

LLMs

Evaluation frameworks

CI/CD pipelines

Education

Master’s degree in Data Science / AI / CS

Tools

Databricks

Azure

Python

Job description

1UP Training in Utrecht is seeking an AI Engineer – RAG Platform to enhance a production Retrieval-Augmented Generation system. You will work at the intersection of information retrieval, data science and software engineering to improve performance and user satisfaction.

The role focuses on experimentation, evaluation, and scalable deployment. Collaboration with software engineers, data scientists and product managers is essential, with a hybrid work setup in the Netherlands.