Freelance RAG & Prompt Engineer — Remote (Germany/AT/CH)

vona KI- und Softwareagentur; United States; Remote; USD 83,000 - 165,000; Full time

Benefits offered by this job

Fully remote work

Project-based engagement

Flexible hours

Potential follow-on projects

Job summary

vona KI- und Softwareagentur seeks a freelance RAG engineer to work on client projects remotely from Europe. You’ll design retrieval pipelines, prepare data, and build prompts that ground responses to sources.

You’ll evaluate answer quality, compare cloud versus local hosting, and collaborate with clients to explain trade-offs. Strong Python and LangChain/LlamaIndex skills are required, with fluency in German or English.

Qualifications

• Several years of software development experience, preferably including Python.
• Confident use of LangChain or LlamaIndex and at least one vector database or vector search solution.
• A systematic approach to measuring answer quality.
• Ability to explain technical trade-offs to clients without a technical background.
• Confident communication in German or English.
• Freelance or self-employed status and a base in Germany, Austria, or Switzerland.

Responsibilities

• Design retrieval pipelines by connecting data sources, preparing documents, choosing chunking strategies, and selecting embeddings and retrieval methods.
• Implement solutions with an appropriate framework, such as LangChain, LangGraph, or LlamaIndex.
• Create and version prompts that keep responses grounded in sources and make gaps in available information clear.
• Build representative question sets and evaluate retrieval and answer quality throughout development.
• Assess whether a cloud-hosted or locally run model best fits each project.

Skills

Software development

RAG systems

German or English communication

Tools

LangChain

LlamaIndex

Vector databases

Job description

vona KI- und Softwareagentur seeks a freelance RAG engineer to work on client projects remotely from Europe. You’ll design retrieval pipelines, prepare data, and build prompts that ground responses to sources.

You’ll evaluate answer quality, compare cloud versus local hosting, and collaborate with clients to explain trade-offs. Strong Python and LangChain/LlamaIndex skills are required, with fluency in German or English.