Technical Program Manager, Human Data Annotation (Code) - Paris/London

Mistral AI; City Of London; Hybrid; GBP 60,000 - 80,000; Full time

Job summary

A leading AI firm in London is seeking a skilled Technical Program Manager to enhance their coding research team. This role involves managing human data annotation programs and collaboration with various teams to improve data quality. Ideal candidates have over 5 years of experience in program management and are proficient in Python. The position offers competitive salary and numerous benefits including transportation reimbursements and gym membership allowances.

Benefits

Competitive cash salary and equity

Transportation reimbursement

Gym membership reimbursement

Meal voucher allowance

Full health insurance

Qualifications

• 5+ years of relevant experience, including technical program management and software engineering.
• Excellent project management skills, managing multiple projects simultaneously.
• Highly organized, detail-oriented, and able to work well under pressure.

Responsibilities

• Collaborate with the coding research team to define campaign requirements.
• Establish and maintain relationships with vendors and contractor teams.
• Run end-to-end data annotation campaigns and track progress to completion.

Skills

Project management

Python

Typescript

Stakeholder management

Data annotation

Job description

About Mistral

At Mistral AI, we believe in the power of AI to simplify tasks, save time, and enhance learning and creativity. Our technology is designed to integrate seamlessly into daily working life.

We democratize AI through high-performance, optimized, open-source and cutting-edge models, products and solutions. Our comprehensive AI platform is designed to meet enterprise needs, whether on-premises or in cloud environments. Our offerings include le Chat, the AI assistant for life and work.

We are a dynamic, collaborative team passionate about AI and its potential to transform society.

Our diverse workforce thrives in competitive environments and is committed to driving innovation. Our teams are distributed between France, USA, UK, Germany and Singapore. We are creative, low-ego and team-spirited.

Join us to be part of a pioneering company shaping the future of AI. Together, we can make a meaningful impact. See more about our culture on https://mistral.ai/careers.

Role Summary

We are seeking a highly skilled and motivated Technical Program Manager to join our Science team, with a focus on human data annotations for our coding research team. The role is pivotal in accelerating research at Mistral AI and would be responsible for building and driving human data annotation programs and processes. You would be a critical link between our research, product, engineering, and annotation teams.

What you will do

• Collaborate closely with the coding research team to define campaign requirements, including task guidelines, timeline, budget, and success metrics
• Establish and maintain strong relationships with vendors and contractor teams to generate high quality data, spanning phases across sourcing, contracts, onboarding / training, performance monitoring, etc.
• Run end-to-end annotation campaigns, from scoping, training and calibration, to tracking progress to completion
• Develop and drive both manual and automated data quality audits and product evaluations, producing synthesized feedback and recommendations for key stakeholders, with a strong focus on coding use cases

About you

• 5+ years of relevant experience, including technical program management and software engineering
• Proficient in Python and/or Typescript and at least one related web framework (FastAPI, Django, React...)
• Excellent project management skills, with the ability to manage multiple projects simultaneously
• Experience with operations around data collection, annotation, and/or quality assurance
• Great communication and stakeholder management skills are also essential
• Highly organized, detail-oriented, and able to work well under pressure
• An autonomous and proactive problem-solver with a continuous improvement mindset
• Low ego and team spirit mindset
• Embraces hands-on, operational work

Nice to have:

• Experience with vendor and/or contractor management
• Understanding of and interest in LLMs

Benefits

France:

• Competitive cash salary and equity
• Food: Daily lunch vouchers
• Sport: Monthly contribution to a Gympass subscription
• Transportation: Monthly contribution to a mobility pass
• Health: Full health insurance for you and your family
• Parental: Generous parental leave policy
• Visa sponsorship

UK:

• Competitive cash salary and equity
• Insurance
• Transportation: Reimburse office parking charges, or 90GBP/month for public transport
• Sport: 90GBP/month reimbursement for gym membership
• Meal voucher: £200 monthly allowance for its meals
• Pension plan: SmartPension (percentages are 5% Employee & 3% Employer)