AI Evaluation Lead — Remote Platform & Metrics

Jobgether SRL; Netherlands; Remote; EUR 120,000 - 170,000; Full time

Benefits offered by this job

Equity

Comprehensive health coverage

Relocation assistance

Remote work in Europe

Parental leave

Job summary

Jobgether SRL seeks an Evaluations Team Lead in the Netherlands to shape how AI model evaluations are performed in production. You will build a shared platform, define benchmarks, and drive reproducible pipelines across research, engineering, and customer teams.

You will lead a small team, maintain hands-on Python work, and translate findings into release priorities while ensuring rigorous statistical validation and data quality.

Qualifications

• Proven experience owning evaluation of tabular ML systems in production.
• Strong statistical expertise with metrics, validation, and uncertainty estimation.
• Experience preventing data leakage across training/evaluation splits.
• Proficient in Python and SQL with ML tooling exposure.

Responsibilities

• Lead development of a shared evaluation platform for multiple teams.
• Define rigorous benchmarking standards and reproducible pipelines.
• Assess predictive quality, latency, and cost across configurations.
• Manage a small team of evaluation specialists and mentor staff.

Skills

Python

SQL

Statistics

People management

Model evaluation

Data leakage prevention

Tools

Snowflake

Databricks

ML tooling

Job description

Jobgether SRL seeks an Evaluations Team Lead in the Netherlands to shape how AI model evaluations are performed in production. You will build a shared platform, define benchmarks, and drive reproducible pipelines across research, engineering, and customer teams.

You will lead a small team, maintain hands-on Python work, and translate findings into release priorities while ensuring rigorous statistical validation and data quality.