Data Labeling Lead for AI Safety & RLHF

White Circle; Paris; Hybride; EUR 70 000 - 110 000; Plein temps

Avantages offerts par ce poste

Equity

Flexible time off

Office in Paris (2nd arrondissement)

Relocation support

Private health insurance

Mental health support

Language lessons

Lunch and dinner provided

Learning & development

Tools & equipment

Team off-sites

Résumé du poste

White Circle in Paris is seeking a Data Labeling Lead to build our annotation team from the ground up, setting quality standards, evaluation frameworks, and the labeling operations behind our safety evals, RLHF, and benchmarks.

You will own quality, throughput, and cost while collaborating with AI researchers to translate research goals into scalable labeling workflows and to manage vendor relationships and dashboards for leadership.

Qualifications

• Experience leading data annotation or AI evaluation teams.
• Strong operational and people management skills.
• Understanding of AI model evaluation, LLM behavior, and annotation workflows.
• Ability to design scalable processes without sacrificing quality.
• Excellent communication across technical and non-technical teams.

Responsabilités

• Build from scratch and lead the Data Labeling team (hiring, coaching, performance management).
• Define annotation guidelines, quality standards, and evaluation frameworks.
• Develop quality assurance processes, calibration sessions, and auditing systems.
• Partner with AI researchers and engineers to translate research objectives into labeling workflows.
• Prioritise labeling projects based on business and research needs.
• Monitor operational metrics including quality, throughput, and cost.
• Improve annotation tooling, automation, and workflow efficiency.
• Lead complex AI evaluation projects, including safety, RLHF, and benchmarks.
• Analyze disagreement patterns to improve guidelines and model performance.
• Manage vendor relationships and ensure consistent quality across distributed teams.
• Build reporting dashboards and communicate operational insights to leadership.
• Foster a culture of continuous improvement and accountability.

Connaissances

Data labeling leadership

People management

AI evaluation

Annotation workflows

Process design

Clear communication

Description du poste

White Circle in Paris is seeking a Data Labeling Lead to build our annotation team from the ground up, setting quality standards, evaluation frameworks, and the labeling operations behind our safety evals, RLHF, and benchmarks.

You will own quality, throughput, and cost while collaborating with AI researchers to translate research goals into scalable labeling workflows and to manage vendor relationships and dashboards for leadership.