Applied ML Engineer, North — Evals & Modeling

AI Chopping Block; Greater London; Hybrid; GBP 120,000 - 160,000; Full time

Benefits offered by this job

Lunch stipend

Health and dental benefits

RRSP matching / Pension

Parental leave top-up

Education stipend

6 weeks vacation

Home office stipend

Job summary

Cohere is seeking a hands-on, applied MLE specialist to lead North modelling evaluations. You will define evaluation metrics across enterprise workflows, build robust evals from real usage data, and ensure model progress translates into better product outcomes for North users.

You will collaborate with North product teams, customer-facing teams, and modelling teams to drive practical evaluation workflows and actionable insights.

Qualifications

• Proven experience building evals for LLM-powered or AI product systems.
• Strong judgment on evaluation craft: rubrics, data, failure analysis, regression tracking.
• Ability to translate user signals into measurable metrics.
• Excellent collaboration with product, research, and engineering teams.
• Experience with production ML workflows and deployment considerations.

Responsibilities

• Own the eval strategy for North: define what we measure across agent workflows, tool use, and enterprise knowledge work.
• Build high-quality evals from real product data: user feedback, logs, customer needs, and forward-looking goals.
• Create systems to continuously turn learnings into evals, keeping measurement aligned with product progress.
• Be the voice of North inside modelling: translate eval results into actionable recommendations for central teams.

Skills

Evaluation systems

Data curation

Prompting

Model adaptation

Model selection

Job description

Cohere is seeking a hands-on, applied MLE specialist to lead North modelling evaluations. You will define evaluation metrics across enterprise workflows, build robust evals from real usage data, and ensure model progress translates into better product outcomes for North users.

You will collaborate with North product teams, customer-facing teams, and modelling teams to drive practical evaluation workflows and actionable insights.