Quality and Evals Lead

Bolt

Berlin

Hybrid

EUR 90,000 - 130,000

Full time

37 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Stock options
Wellness program
Hybrid work model
Sabbatical after 5 years

Job summary

Bolt combines automation with human support to assess customer issue resolution. As Quality and Evals Lead, you’ll replace manual audits with automated quality assessment, define the truth of outcomes, and report metrics weekly, while leading a small team and collaborating with analytics and engineering to improve AI-driven resolutions.

You will shape evaluation rubrics, ensure data integrity, and drive rigorous measurement across verticals, balancing speed and accuracy in a hybrid work

Qualifications

  • Experience building evaluation for ML-based or automated resolution at scale.
  • Fluent in SQL and comfortable with Python.
  • Experience replacing a manual audit process with an automated one.
  • Ability to challenge decisions with evidence.
  • Strong data quality and cross-functional collaboration.

Responsibilities

  • Build and run the evaluation framework for automated resolution.
  • Replace manual quality audits with automated assessment across partner teams.
  • Own the quality truth: define solved, reopened and repeated per vertical.
  • Publish the quality floor for automation steps and maintain standards.
  • Lead a team of two to three quality specialists and collaborate with Analytics, Resolution Engine and the automation team.

Skills

SQL
Python
Quality metrics
Stakeholder comms

Job description

About Bolt

Bolt is shaping a future where cities are built for people, not cars. What started as an ambitious project of a 19-year-old in 2013 has grown into a global mobility platform used by more than 200 million customers and 4.5 million driver and courier partners across 50 countries. From ride-hailing and food delivery to scooters, e-bikes, and car-sharing, Bolt helps people move through cities every day. Small, autonomous teams drive this work, combining the speed and ownership of a startup with the scale of a global technology company backed by more than €1bn in funding. And we're just getting started.

Why join Bolt?
  • Build the future of mobility and help transform how people live and move in cities.
  • Tackle challenges at scale that span technology, operations, regulation, and growth.
  • Take real ownership early. Small, lean teams mean your decisions matter from day one, and you'll learn fast alongside some of the best people in the industry.
  • Join one of Europe's leading technology companies, backed by world-class investors including Sequoia.
About The Role

Bolt combines advanced automation with expert human support to resolve customer issues. Both deserve the same honest measurement. You own the independent assessment of whether a customer's problem was actually solved, by a machine or by a person, and you make that measurement continuous, efficient and trusted. As Quality and Evals Lead you replace manual quality audits with automated quality assessment, build the evaluation framework for AI resolution, and own the truth on agent-level and routine-level outcomes: reopen rates, repeat contacts, satisfaction on every contact, policy adherence where it matters. You sit in CX Performance, deliberately apart from the teams that build automation and run the vendors.

Main Tasks And Responsibilities
  • Build and run the evaluation framework for automated resolution: golden sets, rubric-based grading, regression tests, release gates. No routine scales to a new market or intent without passing it.
  • Replace manual quality audits with automated quality assessment across partner teams, at agent level, with calibration against human review on a sample.
  • Own the quality truth: one definition of solved, reopened and repeated per vertical, reported weekly beside automation rate and cost, baselined honestly.
  • Publish the quality floor every automation step must meet (at least as good as human on satisfaction and reopens) and hold the line when the schedule is tight.
  • Lead a team of two to three quality specialists and work daily with Analytics, Resolution Engine and the automation team without being managed by them.
About You
  • You've built evaluation or quality measurement for LLM-based or automated customer resolution at scale, or you have run quality for a large support operation and taught yourself the evals toolkit since.
  • You're fluent in SQL, comfortable in Python, and you know how to design a sample, a rubric and a control.
  • You have replaced a manual audit process with an automated one and can describe what you lost and what you gained.
  • You are comfortable being the person who says a number is not true, and you say it with evidence.
  • You build credibility with business leaders and engineers, communicate directly and challenge decisions with evidence. You're rigorous about data quality and honest about what the results show.
  • You work effectively with few management layers, take ownership of outcomes, move quickly and use resources thoughtfully.
Why you'll love it here
  • Accelerate your professional growth with unique career opportunities.
  • Enjoy a rewarding salary and stock options, knowing that as Bolt succeeds, so do you.
  • Take care of your physical and mental health with our wellness perks.
  • Celebrate 5 years at Bolt with a 1-month paid sabbatical to recharge.
  • Connect with colleagues at annual company events and smaller team gatherings.
  • Balance flexibility and in-person collaboration with our hybrid model, including at least 12 monthly in-office days.

Some perks may differ depending on your location and role.

At Bolt, using AI daily is a baseline expectation for everyone. If there's a faster, smarter way to do your work, we expect you to find it. You're still responsible for the output, so the standard stays high when using AI tools.

Experience is great, but what we really look for is drive, intelligence, and integrity.

Everyone is welcome

Bolt is an equal opportunity employer. We are committed to building a diverse and inclusive workplace where all qualified applicants are considered for employment without regard to race, colour, nationality, religion, gender or gender identity, sexual orientation, age, or disability. We welcome applications from all backgrounds and are happy to make reasonable accommodations throughout our hiring process. If you require any adjustments, please let us know.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Product Manager, Marketplace Balancing
Senior Product Manager, Marketplace Balancing

Bolt Technology • Berlin

Hybrid
EUR 90,000 - 140,000
Stock options
Wellness program
Sabbatical after 5 years
+2
Principal Product Manager, Rides Matching
Principal Product Manager, Rides Matching

Bolt Technology • Berlin

Hybrid
EUR 120,000 - 180,000
Stock options
Wellness perks
Sabbatical after 5 years
+3
Senior Data Platform Engineer, Compute
Senior Data Platform Engineer, Compute

Bolt • Berlin

On-site
EUR 120,000 - 160,000
Senior Product Manager, Marketplace Balancing
Senior Product Manager, Marketplace Balancing

Bolt • Berlin

Hybrid
EUR 90,000 - 140,000
Stock options
Wellness perks
Sabbatical after 5 years
+1
Senior Data Scientist, Micromobility
Senior Data Scientist, Micromobility

Bolt • Berlin

Hybrid
EUR 90,000 - 130,000
Stock options
Hybrid work model
Wellness perks
Senior Product Manager, Supply Incentives
Senior Product Manager, Supply Incentives

Bolt Technology • Berlin

Hybrid
EUR 90,000 - 130,000
Salary and stock options
Wellness perks
Sabbatical after 5 years
+2
B4B Business Development Manager
B4B Business Development Manager

Bolt • Berlin

Hybrid
EUR 70,000 - 110,000
Stock options
Wellness perks
Sabbatical after 5 years
+3
Senior Software Engineer, Data Platform Insights
Senior Software Engineer, Data Platform Insights

Bolt • Berlin

Hybrid
EUR 70,000 - 90,000
Flexible working conditions
Wellness perks
Stock option package
Staff Product Designer, Incentives
Staff Product Designer, Incentives

Bolt • Berlin

Hybrid
EUR 100,000 - 140,000
Stock options
Wellness perks
Sabbatical after 5 years
+2
Regional People Partner
Regional People Partner

Bolt • Berlin

On-site
EUR 65,000 - 90,000