Medior AI Engineer - LLMOps and RAG

Neurho Solutions; Brussel; On-site; EUR 65,000 - 90,000; Full time

Job summary

Neurho Solutions in Belgium seeks a Medior AI Engineer to operate AI assistants and agents as they enter production. You will monitor reliability, security and cost, and work to keep services green as new features go live.

You will maintain ingestion pipelines, evaluate model outputs, and coordinate with content owners and operations teams to deliver fixes and improvements. Fluency in Dutch/French (C2) and English (C1) is expected.

Qualifications

• 4 to 6 years of hands-on experience with Azure DevOps in recent 12 months.
• 4 to 6 years of experience with Azure Kubernetes Service in the last 12 months.
• 4 to 6 years of experience with Azure OpenAI Service in the last 12 months.
• 4 to 6 years of experience with LangChain.
• 4 to 6 years of experience with large language models in the last 12 months.
• 4 to 6 years of experience with Python in the last 12 months.
• 4 to 6 years of experience with RAG in the last 12 months.
• 4 to 6 years of experience with Terraform in the last 12 months.
• 4 to 6 years of experience with vector databases in the last 12 months.
• Dutch or French at C2 level.
• English at C1 level.

Responsibilities

• Monitor availability, latency and errors, handle incidents and investigate root causes.
• Maintain evaluation sets with content owners and track answer quality, feedback and regressions.
• Operate content ingestion pipelines and monitor agent integrations, failures and action logs.
• Validate model, prompt, configuration and security changes before release.
• Track token consumption and service costs, and propose improvements.
• Maintain Terraform, Helm and Azure DevOps artefacts across environments.
• Apply data protection rules, maintain runbooks and report service health.
• Deliver small fixes and enhancements alongside engineers, content owners and operations teams.

Skills

Azure DevOps

Azure Kubernetes Service

Azure OpenAI

LangChain

Large language models

Python

RAG

Terraform

Vector databases

OpenTelemetry

Helm

Infrastructure as code

Incident management

Evaluation sets

Content ingestion

AI agent integrations

Cost monitoring

Tools

Databricks

MLflow

Azure Foundry

Azure API Management

Azure AI Content Safety

Azure AI Search

Kubernetes

Terraform

Job description

We are looking for a Medior AI Engineer to operate AI assistants and agents as they enter production. The services combine RAG with agents that call tools and business systems. You will take over services from the build team and keep them reliable, secure, measurable and cost-efficient as new services go live.

Your role

• Monitor availability, latency and errors, handle incidents and investigate root causes.
• Maintain evaluation sets with content owners and track answer quality, feedback and regressions.
• Operate content ingestion pipelines and monitor agent integrations, failures and action logs.
• Validate model, prompt, configuration and security changes before release.
• Track token consumption and service costs, and propose improvements.
• Maintain Terraform, Helm and Azure DevOps artefacts across environments.
• Apply data protection rules, maintain runbooks and report service health.
• Deliver small fixes and enhancements alongside engineers, content owners and operations teams.

You have

• 4 to 6 years of experience with Azure DevOps, used in the last 12 months.
• 4 to 6 years of experience with Azure Kubernetes Service, used in the last 12 months.
• 4 to 6 years of experience with Azure OpenAI Service, used in the last 12 months.
• 4 to 6 years of experience with LangChain.
• 4 to 6 years of experience with large language models, used in the last 12 months.
• 4 to 6 years of experience with Python, used in the last 12 months.
• 4 to 6 years of experience with RAG, used in the last 12 months.
• 4 to 6 years of experience with Terraform, used in the last 12 months.
• 4 to 6 years of experience with vector databases, used in the last 12 months.
• Dutch or French at C2 level.
• English at C1 level.

A plus

• 4 to 6 years of experience as an AI engineer, including work in the last 12 months.
• Experience with Microsoft Azure.
• Experience with Microsoft Foundry.
• Experience with Azure AI Search.
• Experience with Azure API Management.
• Experience with Azure AI Content Safety.
• Experience with Databricks.
• Experience with MLflow.
• Experience with OpenTelemetry tracing.
• Experience with Helm.
• Experience with infrastructure as code.
• Experience in incident management and root cause analysis.
• Experience maintaining LLM evaluation sets and tracking answer quality.
• Experience operating content ingestion pipelines.
• Experience operating AI agent integrations with business systems.
• Experience monitoring AI service costs and token consumption.

Working at Neurho

Founded in 1998, Neurho is a Belgian IT and business consultancy. For more than 25 years, we have been helping banks, insurers, energy companies and public institutions in Belgium and Luxembourg with their transformation projects. At Neurho, you work on varied and challenging assignments, where your expertise is recognised and your growth encouraged. On top of your salary, you enjoy many extra-legal benefits, designed to suit your role, your needs and your personal wishes.

Neurho is committed to equal opportunity and welcomes every application, regardless of age, origin, nationality, gender, social background, beliefs or disability.