Remote Evaluations Team Lead for Enterprise AI

Jobgether SRL; España; Remoto; EUR 90.000 - 150.000; Tempo pieno

Vantaggi offerti da questo lavoro

Competitive compensation with equity

Health coverage for employees and one‑

Parental leave

Relocation assistance

Remote work across Europe and Israel

Descrizione del lavoro

Partner Company in Spain seeks an Evaluations Team Lead to shape how AI models are evaluated, validated, and improved in production. You will build a shared evaluation platform, set benchmarking standards, and drive data‑driven research with cross‑functional teams.

You will lead a small team, stay hands‑on with Python development, and influence release priorities based on rigorous evaluation findings.

Competenze

• Proven experience owning the evaluation of tabular ML systems in production or high‑impact decision making.
• Strong statistical expertise incl. choosing metrics and validation schemes.
• Experience preventing data leakage across preprocessing, feature engineering, and splits.
• Proficiency in Python and SQL, with ML tooling exposure.

Mansioni

• Build and maintain a shared evaluation platform for research, engineering, and Applied AI teams.
• Develop benchmark suites, datasets, and model comparisons across business use cases.
• Establish rigorous evaluation standards for metrics, validation, data splits, leakage prevention, calibration, and uncertainty.
• Design reproducible evaluation pipelines with versioned inputs and automated regression checks.
• Benchmark models with fair protocols for hyperparameter tuning, resources, and latency.

Conoscenze

Python

SQL

Statistical analysis

Experiment design

People management

Communication

ML tooling/platforms

Snowflake

Databricks

scikit-learn

Strumenti

Snowflake

Databricks

scikit-learn

Descrizione del lavoro

Partner Company in Spain seeks an Evaluations Team Lead to shape how AI models are evaluated, validated, and improved in production. You will build a shared evaluation platform, set benchmarking standards, and drive data‑driven research with cross‑functional teams.

You will lead a small team, stay hands‑on with Python development, and influence release priorities based on rigorous evaluation findings.