AI Evaluation Data Scientist (9-month contract with bonus incentives)

Hyperproof; Barcelona; Híbrido; EUR 50.000 - 70.000; Jornada completa

Descripción de la vacante

A fast-growing deep-tech company is seeking an AI Evaluation Data Scientist to build robust evaluation pipelines for AI systems in a hybrid role based in Barcelona or Madrid. Ideal candidates will possess a Master's degree in a relevant field and have experience in AI/ML model evaluation. This is a great opportunity to work on groundbreaking AI technology in a multicultural environment with a commitment to inclusivity and collaboration.

Servicios

Competitive annual salary

Signing and retention bonuses

Relocation package

Formación

• 2+ years of experience in AI / ML model evaluation or large-scale data analysis.
• Direct experience creating evaluation pipelines for AI or data-driven systems.
• Experience working with large unstructured datasets and data visualization/reporting.

Responsabilidades

• Build robust evaluation pipelines for AI agentic systems.
• Define and track success metrics aligned with production performance.
• Collaborate with engineers and researchers to validate hypotheses.

Conocimientos

Python

Evaluation/data analysis libraries (NumPy, Pandas, scikit-learn)

AI/ML model evaluation

Large-scale data analysis

Educación

Master’s degree in Computer Science, Data Science, Mathematics, Engineering, or related field

Herramientas

ML infrastructure tools

Descripción del empleo

Overview

AI Evaluation Data Scientist (9-month contract with bonus incentives) – Madrid, Barcelona. Hybrid role, contract until June 2026 with bonuses and relocation package if applicable.

We are looking to fill this role immediately and are reviewing applications daily. Expect a fast, transparent process with quick feedback.

Why join us?

We are a European deep-tech leader in quantum and AI, backed by major global strategic investors and strong EU support. Our groundbreaking technology is transforming how AI is deployed worldwide — compressing large language models by up to 95% without losing accuracy and cutting inference costs by 50–80%. Joining us means working on cutting-edge solutions that make AI faster, greener, and more accessible.

We are a fast-scaling Series B company at the forefront of deep tech in a multicultural environment with international exposure.

Benefits

• Competitive annual salary
• Two unique bonuses: signing bonus at incorporation and retention bonus at contract completion.
• Relocation package (if applicable).
• Hybrid role and flexible working hours.
• Be part of a fast-scaling Series B company at the forefront of deep tech.
• Equal pay guaranteed.
• International exposure in a multicultural, cutting-edge environment.

Role

AI Evaluation Data Scientist

As an AI Evaluation Data Scientist, you will

• Build robust evaluation pipelines that accurately mirror real production use cases for AI agentic systems and SML components.
• Define and track success metrics for both agentic workflows and key model components, focusing on measurement aligned with practical production performance rather than pure benchmarks.
• Design annotation frameworks and automated evaluation tools to conduct rigorous, repeatable analysis of model / system output.
• Execute deep-dive data investigations, monitor success and failure cases, and deliver actionable feedback loops to guide model / system improvements.
• Collaborate with engineers and researchers to shape experiments, validate hypotheses, and iterate toward higher performing model deployments.
• Communicate evaluation methodologies, results, and insights to technical and non-technical stakeholders, supporting ongoing improvement and transparency.

Required Qualifications

• Master’s degree in Computer Science, Data Science, Mathematics, Engineering, or related field.
• 2+ years of experience in AI / ML model evaluation or large-scale data analysis.
• Strong proficiency in Python, and evaluation / data analysis libraries (NumPy, Pandas, scikit-learn, etc.).
• Direct experience creating evaluation pipelines for AI or data-driven systems, with a track record in metric definition and performance analysis.
• Familiarity with ML infrastructure (experiment tracking, model versioning, continuous evaluation).
• Experience working with large unstructured datasets and data visualization / reporting to communicate findings.

Preferred Qualifications

• Experience evaluating generative AI agents, LLMs, or advanced SML components in production or R&D settings.
• Exposure to human annotation workflows and automated labeling tools.
• Knowledge of statistical analysis, fairness, bias, and robust metric development for model evaluation.
• Familiarity with ML experimentation platforms, cloud-based AI infrastructure, and advanced model validation techniques.

About Multiverse Computing

Founded in 2019, we are a well-funded, fast-growing deep-tech company with a team of 180+ employees worldwide. Recognized by CB Insights (2023 & 2025) as one of the Top 100 most promising AI companies globally, we are also the largest quantum software company in the EU.

Our flagship products address critical industry needs :

• CompactifAI → a groundbreaking compression tool for foundational AI models, reducing their size by up to 95% while maintaining accuracy, enabling portability across devices from cloud to mobile and beyond.
• Singularity → a quantum and quantum-inspired optimization platform used by blue-chip companies in finance, energy, and manufacturing to solve complex challenges with immediate performance gains.

You’ll be working alongside world-leading experts in quantum computing and AI, developing solutions that deliver real-world impact for global clients. We are committed to an inclusive, ethics-driven culture that values sustainability, diversity, and collaboration — a place where passionate people can grow and thrive. Come and join us!

As an equal opportunity employer, Multiverse Computing is committed to building an inclusive workplace. The company welcomes people from all backgrounds, including age, citizenship, ethnic and racial origins, gender identities, individuals with disabilities, marital status, religions and ideologies, and sexual orientations to apply.

Location & Employment details

Locations: Madrid, Barcelona

Department: Technical

Employment type: Contract

Workplace type: Hybrid

Seniority level: Associate