Medior AI Engineer

NTek Software Solutions; Brussel Hoofdstad; Hybrid; EUR 65,000 - 95,000; Full time

Job summary

CLIENT is building AI services for Brussels public transport, delivering AI agents and retrieval assistants across the organization. The Medior AI Engineer will own the Run phase, keeping services reliable, measured, secure and cost-efficient in production.

You will collaborate with the AI Platform Architect, Senior AI Engineers, business owners, and IT operations teams. The AI Platform runs hybrid using Azure with OpenAI models, Azure AI Search, and self-hosted components on AKS, with LangChain

Qualifications

• Experience operating AI services in production and monitoring performance.
• Familiarity with cost optimization and production reliability practices.

Responsibilities

• Operate AI services in production: monitor availability, latency, errors; handle incidents and service requests.
• Maintain answer quality with evaluation sets and user feedback; detect regressions.
• Manage ingestion pipelines: incremental refresh, failed documents, index health, new content onboarding.
• Oversee agent integrations: monitor calls, handle timeouts, review logs for agents acting on users’ behalf.
• Manage model/version changes, prompts, dependencies, and security updates with safe validation.
• Track run costs per service and propose optimizations.
• Maintain Terraform, Helm and Azure DevOps artefacts; keep DEV/TST/ACC/PROD environments aligned.
• Write runbooks and keep documentation; report health to AI CoE.

Skills

AI engineering

Production monitoring

Incident handling

Python

LangChain

Azure

OpenAI

Terraform

Azure DevOps

Tools

Azure

AKS

MLflow

Databricks

LangChain

OpenTelemetry

Terraform

Azure DevOps

Job description

CLIENT (Brussels public transport operator) is building several employee- and customer-facing AI services, serving our customers and employees across the organization. These range from retrieval-based assistants to AI agents that call tools and business systems on behalf of users. The AI services are built and run on our CLIENT AI Platform. The first services go live from December 2026, and more will follow in 2027.

Your role

We are recruiting a Medior AI Engineer to join the AI Center of Excellence (Digital Innovatin & AI - delivery team) and own the Run phase of our AI services in production. You take over each service from the Senior AI Engineers who built it, and you keep it reliable, measured, secure and cost-efficient over time. You will work alongside CLIENT’s internal AI Platform Architect, two Senior AI Engineers (Build), the business and content owners of each service, and CLIENT’s IT operations teams.

The AI Platform runs on a hybrid operating model: managed Azure services (Microsoft Foundry with the OpenAI model family for LLM and embeddings, Azure AI Search, Azure API Management, Azure AI Content Safety) combined with self-hosted open-source components on AKS (agent orchestration in Python with LangChain, ingestion pipeline), with MLflow on Databricks for evaluation and tracing (OpenTelemetry). The Digital Innovation / AI CoE team owns Infrastructure-as-Code for all application-scoped Azure resources, using Terraform and Azure DevOps pipelines.

What you will deliver

Activities will vary from service to service. Typically you will:

• operate the AI services in production: monitor availability, latency and errors, handle incidents and service requests, analyse root causes, then fix or elevate ;
• keep answer quality under control: run and maintain evaluation sets (golden sets) with business content owners, track answer quality, non-answer rate and user feedback, and detect and investigate quality regressions ;
• operate the ingestion pipelines: incremental refresh, failed documents, index health, and onboarding of new content sources or business domains within existing connectors ;
• operate agent integrations: monitor tool and integration calls to business systems, handle failures and timeouts, and review action logs and exceptions for agents that act on users’ behalf ;
• manage change safely: model version upgrades and retirements, prompt and configuration changes, dependency and security updates, each validated against the evaluation sets before release ;
• follow run cost: token consumption and cost per service, alerting on drift and proposing optimisations ;
• maintain the Terraform, Helm and Azure DevOps artefacts, and keep the DEV, TST, ACC and PROD environments consistent ;
• apply data protection rules: trace retention, erasure and access restrictions, as defined in each service’s data protection impact assessment ;
• maintain runbooks and documentation, and report service health to service owners and the AI CoE on a regular basis ;
• deliver small enhancements and fixes; structural changes and new features stay with the Build team.