Remote ML Evaluation Scientist - Domain Expert

Alignerr Corp.; Greater London; On-site; GBP 83,000 - 165,000; Full time

Job summary

Alignerr is seeking researchers and domain experts to design evaluation challenges that push the boundaries of AI systems. You will craft complex ML problems rooted in your domain knowledge and define rigorous evaluation criteria, including gold-standard solutions.

You will collaborate asynchronously with a global team, publish or build on existing research, and enjoy full autonomy over your schedule in a flexible, remote hourly contract.

Qualifications

• Graduate-level expertise in a scientific or technical domain that intersects with machine learning.
• Strong working knowledge of ML methods - model selection, feature engineering, evaluation metrics, and pipeline design.
• Deep familiarity with active research problems in your field.
• Able to identify precisely where general ML knowledge falls short and specialized domain insight becomes critical.
• Experience publishing or conducting original research is highly valued.
• Excellent written communication - you can articulate complex problems clearly and precisely.
• Self-motivated and comfortable working independently on intellectually demanding tasks.

Responsibilities

• Design complex, original machine learning problems rooted in your specific domain of expertise
• Craft evaluation tasks that require advanced domain knowledge well beyond standard ML pipelines
• Draw from your own research experience to create problems that genuinely challenge state-of-the-art AI
• Define rigorous problem statements, evaluation criteria, and gold-standard solutions
• Assess AI-generated ML solutions for correctness, creativity, and methodological soundness
• Document problem difficulty levels, required domain knowledge, and expected AI failure modes
• Collaborate asynchronously with a global team of researchers and engineers

Skills

ML knowledge

Model selection

Feature engineering

Evaluation metrics

ML pipeline design

Written communication

Independent work

Education

MS or PhD preferred

Job description

Alignerr is seeking researchers and domain experts to design evaluation challenges that push the boundaries of AI systems. You will craft complex ML problems rooted in your domain knowledge and define rigorous evaluation criteria, including gold-standard solutions.

You will collaborate asynchronously with a global team, publish or build on existing research, and enjoy full autonomy over your schedule in a flexible, remote hourly contract.