AI Evaluations Lead & Platform Architect

Jobgether SRL; Schweiz; Remote; CHF 140,000 - 210,000; Full time

Benefits offered by this job

Competitive equity

Health coverage for employees and deps

Parental leave

Relocation assistance

Remote work across Europe & Israel

Job summary

Jobgether SRL in Switzerland is seeking an Evaluations Team Lead to shape how AI models are evaluated, validated, and improved in production. You will lead a shared evaluation platform across research, engineering, and customer-facing teams, establishing benchmarking standards and reproducibility.

You will manage a small team while remaining hands-on in code, experiments, and methodology. The role emphasizes predictive quality, latency, and cost efficiency to guide research and product releases,

Qualifications

• Experience owning production evaluation of ML systems.
• Strong statistical methods and uncertainty estimation.
• Experience preventing data leakage across splits.
• Ability to lead and grow a team.
• Excellent communication with researchers and engineers.

Responsibilities

• Build and maintain a shared evaluation platform for multiple teams.
• Develop benchmark suites and model comparisons.
• Establish evaluation standards for metrics, splits, and calibration.
• Design reproducible pipelines with versioned data.
• Lead a small team of evaluation specialists.
• Stay hands-on with Python, experiments, and methodology.

Skills

Python

SQL

Statistical analysis

Experiment design

Leadership

Team management

Snowflake

Databricks

scikit-learn

Tools

ML platforms

Job description

Jobgether SRL in Switzerland is seeking an Evaluations Team Lead to shape how AI models are evaluated, validated, and improved in production. You will lead a shared evaluation platform across research, engineering, and customer-facing teams, establishing benchmarking standards and reproducibility.

You will manage a small team while remaining hands-on in code, experiments, and methodology. The role emphasizes predictive quality, latency, and cost efficiency to guide research and product releases,