Senior Machine Learning Engineer – LLMs

Prosus; Amsterdam; Hybrid; EUR 120,000 - 190,000; Full time

Benefits offered by this job

High-impact AI projects

Expert colleagues

Competitive compensation

Modern tooling

Job summary

A leading tech investment company in the Netherlands is seeking a Senior Machine Learning Engineer to lead AI projects and mentor a team. You will conduct rigorous experiments to improve model performance and have deep hands-on experience in training language models. This role offers high-impact projects with significant autonomy, access to state-of-the-art infrastructure, and a hybrid work model. Join a team committed to pushing the boundaries of AI with a focus on professional growth.

Qualifications

• 7+ years of ML engineering experience.
• Experience training and deploying language models to production.
• Strong understanding of training dynamics at scale.
• Experience preparing large-scale training datasets: filtering, quality assessment, deduplication, data mixture design.
• Hands-on with distributed training frameworks and multi-node orchestration.
• Strong understanding of training dynamics at scale and resolving instabilities.
• Expert Python and PyTorch with production training libraries.

Responsibilities

• Analyze model performance and training data.
• Drive technical decision-making for model architecture.
• Provide technical leadership and mentorship.
• Train large language models through pre-training and fine-tuning on proprietary data.
• Build distributed training infrastructure across multi-node GPU clusters with DeepSpeed, FSDP, Megatron-LM, or Axolotl.
• Prepare and curate data for training at 100B+ tokens scale.

Skills

Python

PyTorch

Technical leadership

Distributed training frameworks

Data filtering

Tools

DeepSpeed

FSDP

Megatron-LM

Transformers

Job description

Join our AI team at Prosus, the largest consumer internet company in Europe and one of the biggest tech investors in the world. You'll be working on the team that drives growth and innovation across the company, with your work directly impacting how millions of people shop online.

Who We’re Looking For

We're seeking a Senior Machine Learning Engineer to train domain‑specific language models and provide technical leadership to the team. You'll own critical parts of our training infrastructure, mentor engineers, and drive technical decisions from data preparation through production deployment. You have deep hands‑on experience training language models at scale, lead by example through rigorous experimentation and high‑quality code, and are motivated by seeing your work deployed to millions of users. You thrive in fast‑paced environments where you balance technical depth with practical business impact.

What You’ll Do

• Analyze model performance and training data, formulate hypotheses, design and execute rigorous experiments to systematically improve model quality, training and inference efficiency, and downstream task performance
• Drive technical decision‑making for model architecture, training strategies, and infrastructure choices
• Provide technical leadership and mentorship to ML engineers and interns, conducting code reviews, sharing best practices, and accelerating team growth
• Train large language models through continued pre‑training and full parameter fine‑tuning on proprietary datasets
• Build and optimise distributed training infrastructure across multi‑node GPU clusters using frameworks like DeepSpeed, FSDP, Megatron‑LM, or Axolotl
• Own large‑scale data preparation: filtering, quality assessment, deduplication, and data mixture strategies for training corpora at 100B+ token scale
• Generate and curate high‑quality synthetic data for instruction fine‑tuning and capability enhancement
• Debug training stability issues, optimise training and inference throughput (quantisation, distillation, serving optimisation), and monitor model performance throughout long‑running distributed jobs
• Build robust evaluation frameworks and establish metrics to measure model quality and guide decisions
• Write production‑grade, well‑tested code and set engineering standards for the team

Minimum Qualifications

• 7+ years of ML engineering experience
• Technical leadership experience: mentoring engineers, conducting code reviews, making architecture decisions, and delivering projects with measurable business impact
• Proven experience training and deploying language models to production (embedding models, encoder models, or large language models) including pre‑training, continued pre‑training, or fine‑tuning with rigorous evaluation and inference optimisation
• Experience preparing large‑scale training datasets: data filtering, quality assessment, deduplication strategies, and data mixture design
• Hands‑on experience with distributed training frameworks (DeepSpeed, FSDP, Megatron‑LM, or Axolotl) including orchestrating multi‑node jobs, debugging failures, and optimizing throughput
• Strong understanding of training dynamics at scale: debugging loss instabilities, tuning learning rate schedules, managing training stability across long‑running multi‑node jobs
• Expert Python and PyTorch with production experience using training libraries (Transformers, DeepSpeed, Accelerate)

Preferred Qualifications

• Published research at ML conferences (NeurIPS, ICML, ICLR, ACL, EMNLP), released models on Hugging Face, created public benchmarks, or contributed to open‑source projects
• Experience with post‑training methods: RLHF, DPO, GRPO, or other reinforcement learning approaches for alignment and instruction‑following
• Experience optimising models for production inference including quantisation, model compression, distillation, and serving frameworks (vLLM, TensorRT‑LLM)
• Understanding of memory optimisation: gradient checkpointing, mixed precision training (FP16, BF16, FP8), ZeRO optimisation
• Deep knowledge of GPU architectures (A100, H100, H200) and their implications for training and inference optimisation
• Track record of building synthetic data generation pipelines for instruction tuning or domain adaptation

What We Offer

• High‑impact AI projects that are strategically vital to the company, with direct engagement from senior leadership including the CEO
• State‑of‑the‑art infrastructure: H200 GPU fleet, massive proprietary datasets, access to frontier models (OpenAI, Anthropic, Google, Together.ai) for evaluation and baselines
• Expert colleagues who have released top Hugging Face models, authored papers at NeurIPS, created well‑known benchmarks, and built multiple production AI systems
• Significant autonomy and freedom to test ideas, experiment with new approaches, and drive technical decisions
• Modern tooling: Latest ML frameworks, coding assistants, best‑in‑class development environment
• Hybrid work model with our Amsterdam office – home to the AI House, bringing together 200+ AI professionals through events, meetups, and startup collaborations
• Competitive compensation, top‑spec MacBook Pro, and an environment genuinely built for professional growth and learning
• If you're excited to apply your LLM training expertise to high‑impact applications at scale, lead technical initiatives, and grow the next generation of ML engineers, let's talk.

Our Diversity & Inclusion Commitment

We respect the dignity and human rights of individuals and communities wherever we operate in the world. Building an inclusive workplace where everyone feels welcome and can thrive is critical for us. We provide access to education, which helps everyone understand the important role they play and the positive impact they can have.

For a deeper look at our journey and future plans, explore our latest Annual Report. Stay up to date with our latest news to see what makes Prosus stand out. Learn more at www.prosus.com. If you’re excited to push the boundaries of AI applications — and to see your work make a tangible difference on a global scale—let’s talk.