AI Evaluation Specialist - Remote Contract

Crossing Hurdles; United States; Remote; USD 28,000 - 83,000; Part time

Job summary

Crossing Hurdles is seeking a motivated Evaluation Specialist/Recent Grad for a contract, remote position. Compensation ranges from $20 to $60 per hour, with a commitment of 10-40 hours per week. This remote role supports AI model testing and content development.

The ideal candidate will conduct independent research, craft nuanced questions, and maintain high-quality documentation while working in a self-directed, remote environment.

Qualifications

• Proven ability to conduct thorough, independent research and evaluate information critically.
• Exceptional attention to detail and written precision in English.
• Talent for crafting nuanced and well-structured questions.
• Strong self-direction, reliability, and accountability in remote work.
• Interest in AI and a passion for testing model capabilities.

Responsibilities

• Develop original, challenging question-and-answer pairs to test AI models.
• Conduct in-depth research with rigorous source triangulation for accuracy.
• Create multi-step questions requiring synthesis and analytical reasoning.
• Test questions against AI models, analyze outcomes, and iterate difficulty.
• Document research process with clear citations and logical explanations.
• Refine content based on reviewer input and maintain quality standards.

Skills

Research skills

Critical thinking

Attention to detail

Written communication

Question design

Remote work

Self-motivation

Accountability

AI interest

Job description

Crossing Hurdles is seeking a motivated Evaluation Specialist/Recent Grad for a contract, remote position. Compensation ranges from $20 to $60 per hour, with a commitment of 10-40 hours per week. This remote role supports AI model testing and content development.

The ideal candidate will conduct independent research, craft nuanced questions, and maintain high-quality documentation while working in a self-directed, remote environment.