Senior ML Architect – Post-Training & Evaluation

Toloka; España; Remote; EUR 110,000 - 140,000; Full time

Benefits offered by this job

IT setup allowance

Home office stipend

Paid PTO

Job summary

Toloka is a remote-first ML team powering Toloka’s platform with advanced post-training, RLHF/RLAIF, and alignment technologies. The Principal ML Researcher will define the technical vision, drive research strategy, and mentor engineers to push frontier AI at scale.

Working across greenfield post-training paradigms, you will shape agent behaviors, evaluation harnesses, and deployment strategies while collaborating with product and executive leadership.

Qualifications

• 6+ years in ML engineering or applied research.
• 3+ years leading LLM post-training, fine-tuning, or alignment initiatives at scale.
• Mastery of LLM Evaluation & Calibration.
• Expert Distributed Training & Systems Engineering: Python, PyTorch, Deepspeed, Megatron.

Responsibilities

• Define multi-quarter strategy and architecture for Toloka’s post-training stack.
• Architect greenfield post-training & RL pipelines to power LLM alignment at platform scale.
• Design automated evaluation ecosystems and human-aligned judging frameworks.
• Lead inference optimization and model distillation efforts.
• Mentor senior ML researchers and collaborate with cross-functional teams.
• Translate client challenges into scalable platform architecture and write research blogs/talks.

Skills

6+ years ML/AI

LLM post-training

RLHF/RLAIF

Python

PyTorch

Distributed training

English (C1)

Tools

PyTorch

DeepSpeed

Megatron

TensorRT-LLM

vLLM

Job description

Toloka is a remote-first ML team powering Toloka’s platform with advanced post-training, RLHF/RLAIF, and alignment technologies. The Principal ML Researcher will define the technical vision, drive research strategy, and mentor engineers to push frontier AI at scale.

Working across greenfield post-training paradigms, you will shape agent behaviors, evaluation harnesses, and deployment strategies while collaborating with product and executive leadership.