AI Math Benchmark Designer & Evaluator

Crossing Hurdles; Nueva Zelanda; Presencial; NZD 90.000 - 140.000; Jornada completa

Descripción de la vacante

Crossing Hurdles in New Zealand is seeking a scientist to create realistic computational mathematics and statistics tasks that challenge advanced AI models. You will design task instructions, reproducible environments, reference solutions, and robust evaluation criteria.

You will also evaluate model-generated proofs, calculations, code, and optimizations, identifying logical errors, numerical instability, or reproducibility failures.

Formación

• Experience evaluating mathematical or technical tasks.
• Strong practical proficiency with Python.
• Deep expertise in at least one relevant mathematical specialization.

Responsabilidades

• Create realistic computational mathematics and statistics tasks for AI models.
• Develop task instructions, reproducible environments, reference solutions, and evaluation criteria.
• Evaluate model-generated proofs, calculations, code, models, optimizations, and deliverables.
• Identify logical errors, numerical instability, and reproducibility issues.

Conocimientos

Mathematical expertise

Computational methods

AI model evaluation

Herramientas

Python

Descripción del empleo

Crossing Hurdles in New Zealand is seeking a scientist to create realistic computational mathematics and statistics tasks that challenge advanced AI models. You will design task instructions, reproducible environments, reference solutions, and robust evaluation criteria.

You will also evaluate model-generated proofs, calculations, code, and optimizations, identifying logical errors, numerical instability, or reproducibility failures.