Senior LLMOps Engineer

EUROPEAN DYNAMICS Group; Brussel Hoofdstad; On-site; EUR 110,000 - 170,000; Full time

Job summary

EUROPEAN DYNAMICS Group is seeking a Senior LLMOps Engineer fluent in English to join the Belgium-based team, with work on-site at company or customer premises. You will integrate into the Development team and collaborate closely with a major client’s IT group to build secure, scalable ML systems.

The role emphasizes production-grade LLM systems, hybrid infrastructure, and end-to-end MLOps lifecycle management, with a strong focus on automation, monitoring, and security.

Qualifications

• University degree in Computer Science, Information Technology, or Systems Engineering with relevant IT experience at least 10 years.
• Extensive experience managing on-prem and/or cloud LLM/MLOps infrastructure.
• Experience with data analytics over big datasets, non-structured databases and data lakes.
• Experience with monitoring and logging tools (ELK stack, Prometheus, Grafana, OpenTelemetry, CloudWatch).
• Experience with model testing and validation in production environments.
• Deep knowledge of containerisation and orchestration platforms (Kubernetes, Docker, EKS, PKS).
• Knowledge of MLflow, TensorFlow (TFX) or equivalents.
• Knowledge of Airflow.
• Knowledge of AWS or EU cloud providers.
• Proficiency in Python, Unix, and Bash.
• Familiarity with Agile software development methodologies.
• Knowledge of infrastructure as code (Terraform, CloudFormation).
• Excellent knowledge of messaging services (Kafka, Redis, RabbitMQ).
• Knowledge of NoSQL databases like OpenSearch, MongoDB, and query languages (SQL, Hive, Pig).
• Excellent command of English.

Responsibilities

• Design, build, and maintain production-grade ML systems with a strong focus on LLMs in a hybrid on-prem / cloud infrastructure.
• Deploy, test, manage and monitor ML models across containerized environments.
• Collaborate with data scientists and developers to build, test, deploy and integrate ML models.
• Evolve LLMOps lifecycle including data prep, fine-tuning, evaluation, deployment, monitoring and iteration.
• Analyse performance metrics and troubleshoot to ensure high availability and reliability.
• Design CI/CD pipelines, use orchestration solutions and data versioning tools.
• Create automated anomaly detection and optimize ML pipelines for scalability and cost-efficiency.
• Provide security assessments and guidance on LLM/MLOps practices.
• Support and mentor team members on LLMOps/MLOps best practices.

Skills

LLMOps

Kubernetes

Docker

Python

Unix

Bash

Cloud experience

MLflow

Education

University degree in Computer Science / IT / Systems Engineering

Tools

ELK stack

Prometheus

Grafana

OpenTelemetry

CloudWatch

Terraform

Docker

Job description

We currently have a vacancy for a Senior LLMOps Engineer fluent in English, to offer his/her services as an expert who will be based in Belgium. The work will be carried out either in the company’s premises or on site at customer premises. In the context of the first assignment, the successful candidate will be integrated in the Development team of the company that will closely cooperate with a major client’s IT team.

Your tasks:

• Design, build, and maintain production-grade ML systems with a strong focus on Large Language Models (LLMs) in a secure hybrid on-prem / cloud infrastructure;
• Deploy, test, manage and monitor ML models in different containerized environments;
• Work closely with data scientists and back-end developers to build, test, integrate and deploy ML models;
• Evolve the LLMOps lifecycle: data preparation, fine-tuning, evaluation, deployment, monitoring, and iteration. Develop evaluation frameworks for LLM quality, robustness, and regression tracking;
• Analyse performance metrics and troubleshoot issues to ensure high availability and reliability;
• Design CI/CD pipelines, use orchestration solutions and data versioning tools;
• Creating automated anomaly detection systems and constant tracking of its performance and optimizing ML pipelines for scalability, efficiency and cost-effectiveness;
• Provision of security studies, security assessments or other security matters associated with information system projects;
• Provision of support and guidance to other team members on LLMOps/MLOps practices.

• University degree in a relevant field such as Computer Science, Information Technology, or Systems Engineering combined with relevant IT professional experience of at least 10 years;
• Excellent experience of managing an on-prem and/or cloud LLM / MLOps infrastructure;
• Experience with data analytics over big datasets, non-structured databases as well as data lakes;
• Experience with monitoring and logging tools (e.g. ELK stack, Prometheus, Grafana, OpenTelemetry, Cloudwatch);
• Experience with model testing and model validation in production environments;
• In depth knowledge of containerisation and orchestration platforms (e.g. Kubernetes, Docker, Podman, EKS, PKS);
• Good knowledge of MLflow, TensorFlow (TFX) or equivalents;
• Good knowledge of Airflow;
• Good knowledge of AWS or EU cloud providers;
• Good knowledge of Python;
• Good knowledge of Unix and Bash;
• Good knowledge agile software development methodologies;
• Good knowledge of infrastructure as code (Terraform, CloudFormation);
• Excellent knowledge of messaging services and platforms (e.g. Kafka, Redis, RabbitMQ);
• Knowledge of NoSQL databases, such as OpenSearch, MongoDB as well as query languages, such as SQL, Hive, Pig, etc. and with information extraction;
• Excellent command of the English language.

We offer a competitive remuneration (either on contract basis or remuneration with full benefits package), based on qualifications and experience. All applications will be treated as confidential.

EUROPEAN DYNAMICS(www.eurodyn.com) is a leading European Software, Information and Communication Technologies company, operating internationally (Athens, Brussels, Luxembourg, Copenhagen, Berlin, Stockholm, London, Nicosia, Valetta, Vienna, Den Haag, Hong Kong, etc.) The company employs over 1000 engineers, IT experts and consultants (around 3% PhD, 36% MSc and 53% BSc). We design and develop software applications using integrated, state-of-the-art technology. Our current IT projects have a value exceeding 300 million EURO. EUROPEAN DYNAMICS is a renowned supplier of IT services to European Union Institutions, international organizations, European Agencies and national government Administrations in 40 countries and 4 continents.

As part of our dedication to the diversity of our workforce, we are committed to Equal Employment Opportunity without regard for race, color, age, national origin, ethnicity, gender, disability, sexual orientation, gender identity or religion.

EUROPEAN DYNAMICS (ED) adheres to the General Data Protection Regulation principles by applying its Privacy Policy as published in www.eurodyn.com/privacy. By submitting an application to this position and by sharing your personal data with ED, you acknowledge and accept its Policy and authorise ED to process your personal data for the purposes of the company's recruitment opportunities, in line to the Policy.