ML Ops/LLM Ops Engineer - EU Institution (based in Belgium)

NRB

Brussel

Hybrid

EUR 90,000 - 140,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

KEYES is seeking a Senior ML / LLM Engineer in Brussels to design and run production-grade ML systems within a secure hybrid on-premise and cloud setup. You will deploy, test, and monitor LLM models while collaborating with data scientists and developers to scale solutions.

The role focuses on LLMOps, data prep, fine-tuning, evaluation, and CI/CD pipelines, ensuring high reliability and security across EU institutions’ projects.

Qualifications

  • Master’s/Bachelor’s degree; Minimum 7 years of experience in Data, AI, LLMs.
  • Excellent knowledge of managing an on-prem and/or cloud LLM / MLOps infrastructure.
  • Excellent knowledge of containerisation and orchestration platforms (e.g. Kubernetes, Docker, Podman, EKS, PKS).
  • Good knowledge of MLflow, TensorFlow (TFX) or equivalents.
  • Good knowledge of Airflow.
  • Good knowledge of AWS or EU cloud providers.
  • Good knowledge of Python.
  • Good knowledge Unix and Bash.
  • Good knowledge agile software development methodologies.
  • Good knowledge infrastructure as code (Terraform, CloudFormation).
  • Good knowledge of messaging services and platforms (e.g. Kafka, Redis, RabbitMQ).
  • Knowledge of data security measures (encryption, ML security a plus).
  • Knowledge of NoSQL databases (OpenSearch, MongoDB).
  • Knowledge of query languages (SQL, Hive, Pig).
  • Experience with data analytics over big datasets and data lakes.
  • Experience with monitoring and logging tools (ELK, Prometheus, Grafana, OpenTelemetry, Cloudwatch).
  • Experience with model testing and validation in production environments.
  • Ability to write clear technical documentation.
  • Knowledge of EU Institutions’ grant management ecosystem (an asset).

Responsibilities

  • Design, build, and maintain production-grade ML systems with strong focus on LLMs in secure hybrid on-prem / cloud infrastructure.
  • Deploy, test, manage and monitor ML models in containerised environments.
  • Collaborate with data scientists and back-end developers to deploy ML models.
  • Evolve LLMOps lifecycle: data prep, fine-tuning, evaluation, deployment, monitoring, iteration.
  • Develop evaluation frameworks for LLM quality, robustness, regression tracking.
  • Analyse performance metrics and troubleshoot to ensure high availability.
  • Design CI/CD pipelines, orchestration solutions and data versioning tools.
  • Create automated anomaly detection systems and optimize ML pipelines for scalability and cost-efficiency.
  • Provide security studies and guidance on information system projects.
  • Support and guide team members on LLMOps/MLOps practices.

Skills

Data AI
LLMs
On-prem/cloud
LLMOps
Python
Kubernetes
Docker
Terraform
SQL
NoSQL
Airflow
Security
Monitoring
Documentation

Education

Master’s/Bachelor’s degree

Tools

Kubernetes
Docker
Podman
EKS
PKS
MLflow
TensorFlow
Airflow

Job description

Joining KEYES means giving purpose to your talent. Who are we? Are you looking for an environment where technology is not an end in itself, but a lever to build a sustainable future? At KEYES, we are not just looking for technical expertise; we are looking for people who share our values. Do you want to continue your career and grow within one of Belgium’s leading IT companies? KEYES - International Organizations (IO) is a dynamic global organization that takes pride in being the trusted partner of EU Institutions. With strong commitment to excellence and a 30-years track record of delivering high-quality solutions, we are dedicated to supporting the growth and success of our clients. Our Mission is to help our clients keep up with the challenges of digital transformation by providing the right talent at the right time for the right job. To this end, we are constantly looking for talented professionals who are interested in working on challenging international projects and able to deliver high-quality results within multicultural environments. Our services include (but are not limited to) modernization of solutions, digital workspaces, cloud technologies and IT security.

Our Headquarters are in Brussels and we have active accounts and offices across Europe (i.e. Luxembourg, Amsterdam, Athens, Stockholm, Geneva). More information: www.keyes.eu

Is this YOU? For one of our main clients based in Brussels - a European Institution, we are looking for a Senior ML / LLM Engineer with expertise in on-prem and cloud LLM/MLOps infrastructure to support corporate solutions in the area of research and innovation.

You will be supporting the EU policies on research, science and innovation, with a view to help create growth and jobs and tackle our biggest societal challenges.

Please note that the position is based in Brussels, on hybrid mode, therefore being based in Belgium is required.

  • Design, build, and maintain production-grade ML systems with a strong focus on Large Language Models (LLMs) in a secure hybrid on-prem / cloud infrastructure.
  • Deploy, test, manage and monitor ML models in different containerised environments.
  • Work closely with data scientists and back-end developers to build, test, integrate and deploy ML models.
  • Evolve the LLMOps lifecycle: data preparation, fine-tuning, evaluation, deployment, monitoring, and iteration.
  • Develop evaluation frameworks for LLM quality, robustness, and regression tracking.
  • Analyse performance metrics and troubleshoot issues to ensure high availability and reliability.
  • Design CI/CD pipelines, use orchestration solutions and data versioning tools.
  • Creating automated anomaly detection systems and constant tracking of its performance and optimising ML pipelines for scalability, efficiency and cost-effectiveness.
  • Provision of security studies, security assessments or other security matters associated with information system projects.
  • Provision of support and guidance to other team members on LLMOps/MLOps practices.

#LI-VB1 #TRASYS

Are you the perfect match?

  • Master’s/Bachelor’s degree; Minimum 7 years of experience in Data, AI, LLMs;
  • Excellent knowledge of managing an on-prem and/or cloud LLM / MLOps infrastructure.
  • Excellent knowledge of containerisation and orchestration platforms (e.g. Kubernetes, Docker, Podman, EKS, PKS).
  • Good knowledge of MLflow, TensorFlow (TFX) or equivalents.
  • Good knowledge of Airflow.
  • Good knowledge of AWS or EU cloud providers.
  • Good knowledge of Python.
  • Good knowledge of Unix and Bash.
  • Good knowledge agile software development methodologies.
  • Good knowledge infrastructure as code (Terraform, CloudFormation).
  • Good knowledge of messaging services and platforms (e.g. Kafka, Redis, RabbitMQ).
  • Knowledge of data security measures (knowledge of encryption mechanisms and ML security is considered a plus).
  • Knowledge of NoSQL databases, such as OpenSearch, MongoDB, etc.
  • Knowledge of query languages, such as SQL, Hive, Pig, etc. and with information extraction.
  • Experience with data analytics over big datasets, non-structured databases as well as data lakes.
  • Experience with monitoring and logging tools (e.g. ELK stack, Prometheus, Grafana, OpenTelemetry, Cloudwatch).
  • Experience with model testing and model validation in production environments.
  • Ability to write clear and structured technical documentation.
  • Good knowledge of European Institutions’ grant management ecosystem (eGrants) would be an asset.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ML Ops/LLM Ops Engineer - EU Institution (based in Belgium)
ML Ops/LLM Ops Engineer - EU Institution (based in Belgium)

KEYES • Brussel Hoofdstad

Hybrid
EUR 90,000 - 130,000
MLOps / LLMOps Engineer,Kubernetes & MLflow
MLOps / LLMOps Engineer,Kubernetes & MLflow

Be Consultancy Group BV • Brussel Hoofdstad

Hybrid
EUR 90,000 - 130,000
Senior ML/LLM Ops Engineer - Hybrid (Brussels)
Senior ML/LLM Ops Engineer - Hybrid (Brussels)

NRB • Brussel

Hybrid
EUR 90,000 - 140,000
Senior Data Scientist (NLP, Python) - based in Belgium (EU Institution)
Senior Data Scientist (NLP, Python) - based in Belgium (EU Institution)

KEYES • Brussel Hoofdstad

Hybrid
EUR 75,000 - 110,000
MLOps / LLMOps Engineer Senior
MLOps / LLMOps Engineer Senior

Cronos International • Brussel Hoofdstad

On-site
EUR 70,000 - 110,000
Senior LLMOps Engineer
Senior LLMOps Engineer

EUROPEAN DYNAMICS • Brussel

On-site
EUR 110,000 - 170,000
Senior LLMOps Engineer - AI Systems & Cloud/On-Prem
Senior LLMOps Engineer - AI Systems & Cloud/On-Prem

EUROPEAN DYNAMICS Group • Brussel

On-site
EUR 110,000 - 170,000
Cloud Solution Architect (ML) - Near-Site - 90% Remote (Belgium)
Cloud Solution Architect (ML) - Near-Site - 90% Remote (Belgium)

KEYES • Brussel Hoofdstad

Hybrid
EUR 90,000 - 150,000
Senior LLM/MLOps Engineer - Hybrid On-Prem & Cloud
Senior LLM/MLOps Engineer - Hybrid On-Prem & Cloud

KEYES • Brussel Hoofdstad

Hybrid
EUR 90,000 - 130,000
Operations Engineer senior
Operations Engineer senior

Cronos International • Brussel Hoofdstad

On-site
EUR 85,000 - 125,000