Remote ML Evaluation Architect for Cutting-Edge AI

Alignerr Corp.; Greater London; Remote; GBP 55,000 - 110,000; Part time

Benefits offered by this job

Fully remote contract

Job summary

Alignerr is seeking researchers with deep machine learning knowledge to design evaluation challenges that push the limits of today’s AI systems. You will craft problems rooted in your domain and define rigorous evaluation criteria, drawing on your research experience to create tasks that stress current models.

You will assess AI-generated solutions for correctness and creativity, document difficulty and required knowledge, and collaborate asynchronously with a global team on a fully remote,

Qualifications

• Graduate-level expertise in a scientific or technical domain that intersects with ML.
• Strong working knowledge of ML methods including model selection, feature engineering, evaluation metrics and pipeline design.
• Experience publishing or conducting original research is highly valued.

Responsibilities

• Design complex, original machine learning problems rooted in your domain.
• Craft evaluation tasks that require advanced domain knowledge beyond standard ML pipelines.
• Draw from your research to create problems that challenge state-of-the-art AI.
• Define rigorous problem statements, evaluation criteria, and gold-standard solutions.
• Assess AI-generated ML solutions for correctness, creativity, and methodological soundness.
• Document problem difficulty levels, required domain knowledge, and expected AI failure modes.
• Collaborate asynchronously with a global team of researchers and engineers.

Skills

ML methods

Research experience

Academic writing

Independent work

Domain expertise

Communication

Education

MS or PhD

Job description

Alignerr is seeking researchers with deep machine learning knowledge to design evaluation challenges that push the limits of today’s AI systems. You will craft problems rooted in your domain and define rigorous evaluation criteria, drawing on your research experience to create tasks that stress current models.

You will assess AI-generated solutions for correctness and creativity, document difficulty and required knowledge, and collaborate asynchronously with a global team on a fully remote,