Research Engineer / Scientist, Post-training & Reinforcement Learning - London

H Company; Paris; Hybride; EUR 120 000 - 180 000; Plein temps

Avantages offerts par ce poste

Competitive salary

Hybrid work model

Multicultural team

Résumé du poste

H Company in Paris or London is seeking a senior research engineer to train and improve large language models and vision-language models, with expertise in distributed training and multimodal architectures.

You will implement SFT, RLHF/RLVR, DPO, reward modelling, and work across data pipelines, training backends, and RL algorithms in a collaborative, fast-paced startup.

Hybrid role requires in-office presence roughly three days per week, with occasional travel between offices.

Qualifications

• PhD or MSc in ML, DL, NLP or CV.
• Experience training LLMs/VLMs at scale.
• Strong software engineering and Python/Rust.
• Ability to work across data ingestion to ML/RL design.

Responsabilités

• Develop and train LLMs and VLMs with multimodal architectures.
• Research and implement training methods for instruction following and tool use.
• Design data pipelines and training systems for large-scale distributed training.
• Collaborate with cross-functional teams to integrate models into agentic systems.
• Evaluate model performance and report findings.
• Stay current with advances in LLMs, VLMs, and related fields.

Connaissances

Python

Rust

Distributed training

LLMs/VLMs

PyTorch/JAX/TF

SFT

RLHF/RLVR

reward modelling

Formation

PhD or MSc in ML/NLP/CV

Outils

PyTorch

JAX

TensorFlow

MoE

Distributed Training

Description du poste

About H

H exists to push the boundaries of superintelligence with agentic AI. By automating complex, multi-step tasks typically performed by humans, AI agents will help unlock full human potential.

H is hiring the world’s best AI talent, seeking those who are dedicated as much to building safely and responsibly as to advancing disruptive agentic capabilities. We promote a mindset of openness, learning, and collaboration, where everyone has something to contribute.

About the Research & Models Team

The Models team builds the foundational models that power our cutting-edge agentic technology. We focus on training techniques to optimize model capabilities specifically for agent applications. This allows us to achieve the best performance at a given inference cost.

Our work spans the development of Large Language Models (LLMs) and Vision-Language Models (VLMs), enabling agents to perceive, understand, and act within complex environments. We own the entire pipeline including synthetic data generation, environment design, mid-training, supervised fine-tuning, offline reinforcement learning, online reinforcement learning, reward modelling, transition modelling, etc. Our team also has dedicated MLOps, Infra and Inference support at scale. We focus on improving the long horizon, goal-conditioned instruction-following of large models for GUI/Computer Use agentic interactions, tool use in complex dynamic environments. We regularly ship releases that establish new SOTA in public leaderboards. We parallely operate at the intersection of research and product, translating cutting-edge research into practical solutions that drive the next generation of AI. We are looking for bright, motivated individuals to join us and shape the future of superintelligent AI. Check some of our output

• https://hcompany.ai/holo3

• https://hcompany.ai/holotron3

• https://hcompany.ai/h-joins-nemotron-coalition

• https://hcompany.ai/meet-holotab

Key Responsibilities:

• Develop and train advanced LLMs and VLMs, including multimodal architectures

• Research and implement training methods for enhanced capabilities like instruction following and tool use

• Design and optimize data pipelines and training systems for large-scale distributed training

• Collaborate with cross-functional teams to integrate models into agentic AI systems

• Evaluate model performance and communicate findings to stakeholders

• Stay current with advancements in LLMs, VLMs, and related fields

About you:

You have a strong research engineer / scientist mindset with experience training and improving large language models at different scales in distributed computing settings whether that’s modelling, data collection, experimenting and ablating, implementing SOTA.

Technical skills:

• You have strong programming skills in Python, Rust, or similar; and strong software engineering fundamentals building performant and reliable systems.

• Proficient in deep learning frameworks (Pytorch, JAX, TensorFlow).

• You can work on different layers of the stack from low-level training backends, data ingestion to ML/RL algorithmic design and implementation.

• You know when and where to be rigorous and slower versus when to break and iterate quickly.

• You have trained LLMs/VLMs with techniques such as SFT, DPO, RLHF/RLVR, reward modelling, offline RL, distillation, etc.

• You have experience with offline and online reinforcement learning in or outside of the context of language models.

Preferred:

• Publications in top-tier AI conferences (e.g., NeurIPS, ICML, CVPR, ACL, ICCV, AAMAS, ...)

• Advanced degree (PhD or MSc) in a relevant field (e.g., ML, DL, NLP, CV)

• Experience with large-scale distributed training and inference (multi-node, large models, MoE, parallelism strategies, etc)

• Experience training models for computer use or other multi-turn and/or multimodal agentic settings.

• Extensive experience with reinforcement learning with sparse rewards.

• Experience with multi-domain training, data mixture design, curriculum learning, model merging, distillation.

Soft skills:

• You are a good communicator, collaborative and low-ego.

• You are able to handle a controlled-chaotic environment with a high-degree of between-teams dependencies and collaboration.

• You have a go-do attitude and can balance personal conviction/interests with wider team needs.

• You don't shy away from hard research or engineering problems.

Location:

• Paris or London.

• This role is hybrid, and you are expected to be in the office 3 days a week on average.

• Please expect some travel between offices on a reasonable cadence (e.g., every 4-6 weeks).

What We Offer:

• Join the exciting journey of shaping the future of AI, and be part of the early days of one of the hottest AI startups

• Collaborate with a fun, dynamic and multicultural team, working alongside world-class AI talent in a highly collaborative environment.

• Enjoy a highly competitive salary.

• Unlock opportunities for professional growth, continuous learning, and career development

If you want to change the status quo in AI, join us.