Data Labeling Lead for AI Safety & RLHF

White Circle

Paris

Hybrid

EUR 70,000 - 110,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity
Flexible time off
Office in Paris (2nd arrondissement)
Relocation support
Private health insurance
Mental health support
Language lessons
Lunch and dinner provided
Learning & development
Tools & equipment
Team off-sites

Job summary

White Circle in Paris is seeking a Data Labeling Lead to build our annotation team from the ground up, setting quality standards, evaluation frameworks, and the labeling operations behind our safety evals, RLHF, and benchmarks.

You will own quality, throughput, and cost while collaborating with AI researchers to translate research goals into scalable labeling workflows and to manage vendor relationships and dashboards for leadership.

Qualifications

  • Experience leading data annotation or AI evaluation teams.
  • Strong operational and people management skills.
  • Understanding of AI model evaluation, LLM behavior, and annotation workflows.
  • Ability to design scalable processes without sacrificing quality.
  • Excellent communication across technical and non-technical teams.

Responsibilities

  • Build from scratch and lead the Data Labeling team (hiring, coaching, performance management).
  • Define annotation guidelines, quality standards, and evaluation frameworks.
  • Develop quality assurance processes, calibration sessions, and auditing systems.
  • Partner with AI researchers and engineers to translate research objectives into labeling workflows.
  • Prioritise labeling projects based on business and research needs.
  • Monitor operational metrics including quality, throughput, and cost.
  • Improve annotation tooling, automation, and workflow efficiency.
  • Lead complex AI evaluation projects, including safety, RLHF, and benchmarks.
  • Analyze disagreement patterns to improve guidelines and model performance.
  • Manage vendor relationships and ensure consistent quality across distributed teams.
  • Build reporting dashboards and communicate operational insights to leadership.
  • Foster a culture of continuous improvement and accountability.

Skills

Data labeling leadership
People management
AI evaluation
Annotation workflows
Process design
Clear communication

Job description

White Circle in Paris is seeking a Data Labeling Lead to build our annotation team from the ground up, setting quality standards, evaluation frameworks, and the labeling operations behind our safety evals, RLHF, and benchmarks.

You will own quality, throughput, and cost while collaborating with AI researchers to translate research goals into scalable labeling workflows and to manage vendor relationships and dashboards for leadership.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Data Labeling & AI Evaluation
Lead Data Labeling & AI Evaluation

whitecircle • France

Hybrid
EUR 80,000 - 110,000
Competitive salary + equity
Work from Paris (hybrid) with reloc.包e
Paid time off per local regulations
+3
Senior Data Labeler
Senior Data Labeler

White Circle • Paris

Hybrid
EUR 90,000 - 130,000
Equity compensation
Hybrid work Paris
Relocation package
+3
Senior Data Labeler
Senior Data Labeler

White Circle • Paris

Hybrid
EUR 70,000 - 110,000
Equity
Flexible time off
Office in Paris (2nd arrondissement)
+8
Head of Data Labeling
Head of Data Labeling

whitecircle • France

Hybrid
EUR 80,000 - 110,000
Competitive salary + equity
Work from Paris (hybrid) with reloc.包e
Paid time off per local regulations
+3
Remote Data Annotation Specialist — NLP & CV Labeling
Remote Data Annotation Specialist — NLP & CV Labeling

Rex.zone • Paris

Remote
EUR 28,000 - 42,000
Data Labeling Specialist
Data Labeling Specialist

Alignerr Corp. • France

Remote
EUR 17,000 - 34,000
Remote Data Labeling Specialist for AI Training
Remote Data Labeling Specialist for AI Training

Alignerr Corp. • France

Remote
EUR 17,000 - 34,000
Finance Data Quality Analyst — Hybrid AI Annotation
Finance Data Quality Analyst — Hybrid AI Annotation

Mistral AI • France

Hybrid
EUR 45,000 - 65,000
Healthcare coverage
Retirement plans
Relocation support
+2
Remote AI Generalist: LLM Training & Data QA
Remote AI Generalist: LLM Training & Data QA

Rex.zone • France

Remote
EUR 60,000 - 90,000
Remote AI Data Annotator: NLP & CV Labeling & Evaluation
Remote AI Data Annotator: NLP & CV Labeling & Evaluation

Rex.zone • Paris

Remote
EUR 35,893 - 59,822