Senior LLM/MLOps Engineer - Hybrid On-Prem & Cloud

KEYES; Brussel Hoofdstad; Hybrid; EUR 90,000 - 130,000; Full time

Job summary

KEYES is seeking a Senior ML / LLM Engineer in Brussels to design and maintain production-grade ML systems, focusing on Large Language Models within a secure hybrid on-prem / cloud infrastructure. You will deploy, test, and monitor models, collaborating with data scientists and back-end developers to deliver robust ML solutions.

The role requires 7+ years in Data/AI/LLMs, strong expertise in LLMOps, containerisation, and cloud platforms.

Qualifications

• Master’s or Bachelor’s degree in a relevant field.
• Minimum 7 years of experience in Data, AI, LLMs.
• Excellent knowledge of managing an on-prem and/or cloud LLM / MLOps infrastructure.
• Excellent knowledge of containerisation and orchestration platforms (Kubernetes, Docker, Podman, EKS, PKS).
• Good knowledge of MLflow, TensorFlow (TFX) or equivalents.
• Good knowledge of Airflow.
• Good knowledge of AWS or EU cloud providers.
• Good knowledge of Python.
• Good knowledge of Unix and Bash.
• Good knowledge agile software development methodologies.
• Good knowledge of infrastructure as code (Terraform, CloudFormation).
• Good knowledge of messaging services (Kafka, Redis, RabbitMQ).
• Knowledge of data security measures and data lakes.

Responsibilities

• Design, build, and maintain production-grade ML systems with a strong focus on Large Language Models in a secure hybrid on-prem / cloud infrastructure.
• Deploy, test, manage and monitor ML models in containerised environments.
• Work closely with data scientists and back-end developers to build, test, integrate and deploy ML models.
• Evolve the LLMOps lifecycle: data preparation, fine-tuning, evaluation, deployment, monitoring, and iteration.
• Develop evaluation frameworks for LLM quality, robustness, and regression tracking.
• Analyse performance metrics and troubleshoot issues to ensure high availability and reliability.
• Design CI/CD pipelines, use orchestration solutions and data versioning tools.
• Create automated anomaly detection systems and track performance for scalability, efficiency and cost.

Skills

Data and AI strategy

LLMs

On-prem & cloud ML infra

Containerisation & orchestration

Python

DevOps / MLOps

Kubernetes

Docker

Cloud platforms (AWS, EU)

Security in ML

Education

Master’s/Bachelor’s degree

Tools

Kubernetes

Docker

Podman

EKS

PKS

MLflow

TensorFlow

Airflow

Terraform

CloudFormation

Kafka

Redis

RabbitMQ

Job description

KEYES is seeking a Senior ML / LLM Engineer in Brussels to design and maintain production-grade ML systems, focusing on Large Language Models within a secure hybrid on-prem / cloud infrastructure. You will deploy, test, and monitor models, collaborating with data scientists and back-end developers to deliver robust ML solutions.

The role requires 7+ years in Data/AI/LLMs, strong expertise in LLMOps, containerisation, and cloud platforms.