Senior AI Engineer — RAG Applications (Azure / Kubernetes)

Rhox; Brussel; On-site; EUR 90,000 - 120,000; Full time

Job summary

Rhox in Belgium is seeking a senior AI engineer to build and stabilise retrieval-augmented generation (RAG) applications for employees and customers, from retrieval to answer generation.

You will implement ingestion pipelines with chunking, embeddings and incremental refresh; apply security trimming, ACL propagation, prompt templates and agent guardrails; and deploy services using Helm and Infrastructure-as-Code.

Qualifications

• Senior-level Python and LangChain experience with large language models (LLMs).
• Azure OpenAI Service, Azure AI Search and vector databases experience.
• AKS, Terraform and Azure DevOps pipelines experience.
• Dutch or French, native.
• English, C1.

Responsibilities

• Implement ingestion pipelines with chunking, embeddings and incremental refresh.
• Apply security trimming, ACL propagation, prompt templates and agent guardrails.
• Set up evaluation and tracing with MLflow on Databricks.
• Deploy services using Helm and Infrastructure-as-Code.
• Monitor latency, token consumption, run costs and quality regressions.
• Support hypercare through incident analysis, tuning, runbooks and handover.

Skills

Python

LangChain

LLMs

Tools

Azure OpenAI Service

Azure AI Search

Vector databases

AKS

Terraform

Azure DevOps pipelines

Job description

We're looking for a senior AI engineer to build and stabilise retrieval-augmented generation (RAG) applications for employees and customers, from retrieval to answer generation.

What you'll do

• Implement ingestion pipelines with chunking, embeddings and incremental refresh.
• Apply security trimming, ACL propagation, prompt templates and agent guardrails.
• Set up evaluation and tracing with MLflow on Databricks.
• Deploy services using Helm and Infrastructure-as-Code.
• Monitor latency, token consumption, run costs and quality regressions.
• Support hypercare through incident analysis, tuning, runbooks and handover.

What you bring

• Senior-level Python and LangChain experience with large language models (LLMs).
• Azure OpenAI Service, Azure AI Search and vector databases.
• Azure Kubernetes Service (AKS), Terraform and Azure DevOps pipelines.
• Dutch or French, native.
• English, C1.