MLOps / LLMOps Engineer

Nova Hunte Ltd; Brussel Hoofdstad; Hybrid; EUR 70,000 - 110,000; Full time

Job summary

Nova Hunte Ltd in Brussels seeks an MLOps/LLMOps Engineer to design, build and maintain production-grade ML systems with a strong focus on Large Language Models (LLMs) in a secure hybrid on-prem/cloud infrastructure.

You will deploy, test, manage, and monitor ML models in containerised environments, collaborating with data scientists and back-end developers to deploy models and evolve the LLMOps lifecycle.

Qualifications

• 5+ years in MLOps/LLMOps, production-grade ML systems with LLM focus.

Responsibilities

• Design, build, and maintain production-grade ML systems with a focus on LLMs.
• Deploy, test, manage, and monitor ML models in containerised environments.
• Collaborate with data scientists and developers to deploy ML models.

Skills

MLOps/LLMOps

Python

Unix/Bash

Agile methodologies

CI/CD pipelines

Cloud and on-prem

Kubernetes

Docker

MLflow/TFX

Airflow

Security in ML/InfoSec

Education

Bachelor's Degree in CS/IT/Engineering

Tools

Kubernetes

Docker

Terraform

CloudFormation

Opensearch/MongoDB

Job description

# MLOps / LLMOps EngineerBrussels, Belgium ContractAre you an MLOps / LLMOps Engineer with 5+ years of experience in machine learning operations and LLM infrastructure? Apply now for a long-term contract opportunity with a leading public sector client in Brussels, Belgium.## Requirements* 5+ years of experience in MLOps/LLMOps, building and maintaining production-grade ML systems with a strong focus on Large Language Models (LLMs)* Excellent knowledge of managing on-premises and/or cloud LLM/MLOps infrastructure in secure hybrid environments* Excellent knowledge of containerisation and orchestration platforms (e.g. Kubernetes, Docker, Podman, EKS, PKS)* Good knowledge of MLflow, TensorFlow (TFX) or equivalent ML lifecycle management tools* Good knowledge of Apache Airflow for workflow orchestration* Good knowledge of AWS or EU cloud providers* Good knowledge of Python programming* Good knowledge of Unix and Bash scripting* Good knowledge of Agile software development methodologies* Good knowledge of infrastructure as code tools (Terraform, CloudFormation)* Good knowledge of messaging services and platforms (e.g. Kafka, Redis, RabbitMQ)* Experience with CI/CD pipeline design and deployment* Experience with monitoring and logging tools (e.g. ELK stack, Prometheus, Grafana, OpenTelemetry, CloudWatch)* Experience with model testing, validation, and deployment in production environments* Experience with data analytics over big datasets, non-structured databases, and data lakes* Knowledge of data security measures, encryption mechanisms, and ML security* Knowledge of NoSQL databases (e.g. OpenSearch, MongoDB)* Knowledge of query languages (e.g. SQL, Hive, Pig) and information extraction* Ability to write clear and structured technical documentation* Bachelor's Degree in Computer Science, Information Technology, Systems Engineering, or a relevant field* (Desirable) Knowledge of European Commission grant management ecosystem (eGrants)* Language(s): English (fluent)## Job Description* Design, build, and maintain production-grade ML systems with a strong focus on Large Language Models (LLMs) in a secure hybrid on-premises/cloud infrastructure* Deploy, test, manage, and monitor ML models in different containerised environments* Work closely with data scientists and back-end developers to build, test, integrate, and deploy ML models* Evolve the LLMOps lifecycle, including data preparation, fine-tuning, evaluation, deployment, monitoring, and iteration* Develop evaluation frameworks for LLM quality, robustness, and regression tracking* Analyse performance metrics and troubleshoot issues to ensure high availability and reliability* Design and implement CI/CD pipelines using orchestration solutions and data versioning tools* Create automated anomaly detection systems with constant performance tracking* Optimise ML pipelines for scalability, efficiency, and cost-effectiveness* Conduct security studies, security assessments, and address security matters associated with information system projects* Provide support and guidance to team members on LLMOps/MLOps best practices