RAG & AI Data Engineer: Build Scalable AI Pipelines

Diagonal recruitment; Greater London; On-site; GBP 55,000 - 75,000; Full time

Job summary

Diagonal recruitment is looking for a skilled candidate to design and build data pipelines to support AI applications. You will develop Retrieval-Augmented Generation (RAG) architectures and create vector databases to enhance data retrieval and performance.

The ideal candidate has a strong understanding of data architecture and experience with structured and unstructured datasets. This role focuses on practical AI implementation, ensuring reliable foundations for AI systems in the United Kingdom.

Qualifications

• Experience in building data pipelines for AI or ML applications.
• Understanding of designing or implementing RAG architectures.
• Ability to work with vector databases.

Responsibilities

• Design and build data pipelines to support AI applications.
• Develop Retrieval-Augmented Generation (RAG) architectures.
• Create and maintain vector databases and knowledge repositories.
• Improve retrieval accuracy, relevance, and performance.

Skills

Python

SQL

Vector databases

Embedding models and retrieval frameworks

LangChain or equivalent

Data pipeline and ETL tooling

Job description

Diagonal recruitment is looking for a skilled candidate to design and build data pipelines to support AI applications. You will develop Retrieval-Augmented Generation (RAG) architectures and create vector databases to enhance data retrieval and performance.

The ideal candidate has a strong understanding of data architecture and experience with structured and unstructured datasets. This role focuses on practical AI implementation, ensuring reliable foundations for AI systems in the United Kingdom.