Senior AI Engineer: End-to-End RAG Pipelines & AI Services

Keystone Solutions; Brussel Hoofdstad; Remote; EUR 90,000 - 120,000; Full time

Job summary

Keystone Solutions is seeking a Senior AI Engineer to join a client-site consultancy mission, focusing on developing innovative AI services and end-to-end RAG pipelines. You will collaborate with internal teams to transform complex AI projects into operational services.

Key tech includes Azure OpenAI, AKS, LangChain, and Python, with responsibilities spanning ingestion, security, deployment artifacts, and observability. This role offers hands-on, on-site impact across diverse client environments.

Qualifications

• Experience building production AI services on client-site deployments.
• Strong skills with Python, LangChain and LLMs for end-to-end AI pipelines.
• Proficiency with Azure OpenAI Service, AKS and Azure DevOps in complex environments.
• Ability to design scalable RAG architectures and data ingestion pipelines.

Responsibilities

• Deliver the RAG pipeline end-to-end, from retrieval strategy to answer generation.
• Create the ingestion pipeline: connectors to source platforms, chunking, embedding, incremental refresh.
• Implement security trimming and ACL propagation.
• Manage agent orchestration, prompt templates, and guardrails.
• Set up evaluation and tracing: offline evaluation sets, retrieval and answer-quality metrics, end-to-end tracing.
• Produce Terraform, Helm, and Azure DevOps artifacts needed for service deployment and operation.
• Ensure observability and cost control: instrumentation for latency, token consumption, and run cost, plus quality regression detection after model or prompt changes.
• Provide hypercare and early production support: incident analysis, tuning, runbooks, documentation, and handover of the service to the engineer responsible for the Run phase.

Skills

Python

LangChain

LLM

Azure OpenAI Service

Azure DevOps

Azure Kubernetes Service

RAG

Vector databases

Tools

Azure DevOps

Azure Kubernetes Service (AKS)

Azure OpenAI Service

Terraform

LangChain

Vector databases

Job description

Keystone Solutions is seeking a Senior AI Engineer to join a client-site consultancy mission, focusing on developing innovative AI services and end-to-end RAG pipelines. You will collaborate with internal teams to transform complex AI projects into operational services.

Key tech includes Azure OpenAI, AKS, LangChain, and Python, with responsibilities spanning ingestion, security, deployment artifacts, and observability. This role offers hands-on, on-site impact across diverse client environments.