AI Engineer/Developer

Phoenix Technologies; Brussel Hoofdstad; On-site; EUR 60,000 - 90,000; Full time

Job summary

Phoenix Technologies is seeking an AI Engineer/Developer to join its Brussels team. You will operate AI services in production, maintain evaluation sets, manage ingestion pipelines and agent integrations, and ensure safe change management with emphasis on security and cost efficiency.

You will collaborate with cross-functional teams, align with the Build and CoE units, and contribute to ongoing enhancements in a hybrid, Azure-based platform environment in Brussels.

Responsibilities

• Operate the AI services in production: monitor availability, latency and errors, handle incidents and service requests, analyse root causes, then fix or upscale
• Keep answer quality under control: run and maintain evaluation sets with business content owners, track answer quality, non-answer rate and user feedback, and detect and investigate quality regressions
• Operate the ingestion pipelines: incremental refresh, failed documents, index health, and onboarding of new content sources or business domains within existing connectors
• Operate agent integrations: monitor tool and integration calls to business systems, handle failures and timeouts, and review action logs and exceptions for agents that act on users' behalf
• Manage change safely: model version upgrades and retirements, prompt and configuration changes, dependency and security updates, each validated against the evaluation sets before release
• Follow run cost: token consumption and cost per service, alerting on drift and proposing optimisations
• Maintain the Terraform, Helm and Azure DevOps artefacts, and keep the DEV, TST, ACC and PROD environments consistent
• Apply data protection rules: trace retention, erasure and access restrictions, as defined in each service's data protection impact assessment
• Maintain runbooks and documentation, and report service health to service owners and the AI CoE on a regular basis
• Deliver small enhancements and fixes; structural changes and new features stay with the Build team.

Job description

Role: AI Engineer/Developer

Location: Brussels BE

Language: French OR Dutch

The AI Platform runs on a hybrid operating model: managed Azure services (Microsoft Foundry with the OpenAI model family for LLM and embeddings, Azure AI Search, Azure API Management, Azure AI Content Safety) combined with self-hosted open-source components on AKS (agent orchestration in Python with LangChain, ingestion pipeline), with MLflow on Databricks for evaluation and tracing (OpenTelemetry). The Digital Innovation / AI CoE team owns Infrastructure-as-Code for all application-scoped Azure resources, using Terraform and Azure DevOps pipelines.

What you will deliver

Activities will vary from service to service. Typically you will:

• operate the AI services in production: monitor availability, latency and errors, handle incidents and service requests, analyse root causes, then fix or upscale ;
• keep answer quality under control: run and maintain evaluation sets (golden sets) with business content owners, track answer quality, non-answer rate and user feedback, and detect and investigate quality regressions ;
• operate the ingestion pipelines: incremental refresh, failed documents, index health, and onboarding of new content sources or business domains within existing connectors ;
• operate agent integrations: monitor tool and integration calls to business systems, handle failures and timeouts, and review action logs and exceptions for agents that act on users' behalf ;
• manage change safely: model version upgrades and retirements, prompt and configuration changes, dependency and security updates, each validated against the evaluation sets before release ;
• follow run cost: token consumption and cost per service, alerting on drift and proposing optimisations ;
• maintain the Terraform, Helm and Azure DevOps artefacts, and keep the DEV, TST, ACC and PROD environments consistent ;
• apply data protection rules: trace retention, erasure and access restrictions, as defined in each service's data protection impact assessment ;
• maintain runbooks and documentation, and report service health to service owners and the AI CoE on a regular basis ;
• deliver small enhancements and fixes; structural changes and new features stay with the Build team.