Lead Data Labeling & AI Evaluation Team

Whitecircle; Paris; Hybride; EUR 90 000 - 150 000; Plein temps

Avantages offerts par ce poste

Competitive salary + equity

Hybrid work Paris/London

Relocation package (Paris)

Paid time off

Equipment provided

AI tools subscriptions

Team off-sites

Résumé du poste

White Circle is building the safety, reliability, and optimization layer for AI systems. We seek a leader to build from scratch and run the Data Labeling team, shaping annotation guidelines and QA processes while partnering with researchers and engineers to translate research into labeling workflows.

You will manage complex labeling programs, optimize tooling, and oversee distributed teams, all within a fast-moving startup environment that values continuous improvement and operational excellence.

Qualifications

• Experience leading data annotation or AI evaluation teams.
• Strong operational and people management skills.
• Understanding AI model evaluation and annotation workflows.
• Ability to design scalable processes without sacrificing quality.
• Clear communication across technical and non-technical teams.
• Thrives in fast-moving startup environments.

Responsabilités

• Build from scratch and lead the Data Labeling team (hiring, coaching, and performance management).
• Define annotation guidelines, quality standards, and evaluation frameworks.
• Develop quality assurance processes, calibration sessions, and auditing systems.
• Partner with AI researchers and engineers to translate research objectives into labeling workflows.
• Prioritize labeling projects based on business and research needs.
• Monitor operational metrics including quality, consistency, throughput, and cost.
• Improve annotation tooling, automation, and workflow efficiency.
• Lead complex AI evaluation projects, including safety, preference ranking, RLHF, policy evaluation, and benchmark creation.
• Analyse disagreement patterns and edge cases to improve guidelines and model performance.
• Manage vendor relationships and ensure consistent quality across distributed teams.
• Build reporting dashboards and communicate operational insights to leadership.
• Foster a culture of continuous improvement, accountability, and operational excellence.

Connaissances

Data labeling leadership

Operations management

AI evaluation

Annotation workflows

Communication

Startup mindset

Outils

SQL

Python

Description du poste

White Circle is building the safety, reliability, and optimization layer for AI systems. We seek a leader to build from scratch and run the Data Labeling team, shaping annotation guidelines and QA processes while partnering with researchers and engineers to translate research into labeling workflows.

You will manage complex labeling programs, optimize tooling, and oversee distributed teams, all within a fast-moving startup environment that values continuous improvement and operational excellence.