Senior ML Evaluation Lead - Remote Contract

Alpheva; United States; Remote; USD 248,000 - 317,000; Part time

Job summary

Alpheva seeks a senior AI/ML expert to lead evaluation projects focused on model evaluation, data leakage, training assumptions, and ML reliability. The role involves reviewing model responses and worked examples for gaps and incorrect assumptions, and developing reference answers and scoring criteria grounded in rigorous evidence.

This is a remote, project-based contract. Scope, hours, and assignments depend on project matching; the listed hourly range applies to matched work.

Qualifications

• 7+ years of substantive experience in applied ML or ML research.
• Senior-level judgment in model evaluation, data leakage, training assumptions, and ML reliability.
• Ability to write precise reference answers, assess competing approaches, and justify corrections with traceable evidence.

Responsibilities

• Provide senior AI/ML expertise for evaluation projects.
• Review model responses, worked examples for incorrect assumptions and gaps in reliability or security.
• Write reference answers and scoring criteria and explain errors with evidence.

Skills

Senior ML expertise

Model evaluation

Traceable evidence & justification

Job description

Alpheva seeks a senior AI/ML expert to lead evaluation projects focused on model evaluation, data leakage, training assumptions, and ML reliability. The role involves reviewing model responses and worked examples for gaps and incorrect assumptions, and developing reference answers and scoring criteria grounded in rigorous evidence.

This is a remote, project-based contract. Scope, hours, and assignments depend on project matching; the listed hourly range applies to matched work.