Remote Scientific Computing Researcher - AI Evaluation

Appsierra Group; American Samoa; On-site; USD 96,000 - 110,000; Part time

Job summary

Appsierra Group is seeking a Scientific Computing Research Expert for remote, contractor work crafting research-grade evaluation tasks for AI models. Tasks stem from real computational research and span fields like math and engineering.

You’ll design tasks, define evaluation metrics, and ensure technical soundness through testing and revisions. Qualified candidates hold a PhD or are pursuing one with hands-on research, plus strong Python skills to run and modify analyses.

Qualifications

• Currently pursuing or holding a PhD with active hands-on research experience.
• Master's candidates or graduates may qualify if they have a research-active background, such as thesis-based enrollment, active research assistant or lab role, or peer-reviewed output.
• Strong Python proficiency to run, modify, troubleshoot, and debug computational work.
• Ability to translate research workflows into well-specified evaluation tasks.

Responsibilities

• Design and author original research-grade evaluation tasks based on your own computational research.
• Turn real computational workflows into clearly specified tasks for consistent evaluation.
• Define metrics and criteria to assess solutions without publishing exact passing thresholds.
• Run and debug your own computations to ensure tasks are technically sound.
• Revise submitted tasks based on structured review feedback.
• Respond to reviewer feedback and revise until quality standards are met.
• Optionally review and calibrate tasks submitted by other experts.

Skills

Python

Independent work

Technical writing

Education

PhD candidate/PhD holder

Masters with research background

Tools

Python

Job description

Appsierra Group is seeking a Scientific Computing Research Expert for remote, contractor work crafting research-grade evaluation tasks for AI models. Tasks stem from real computational research and span fields like math and engineering.

You’ll design tasks, define evaluation metrics, and ensure technical soundness through testing and revisions. Qualified candidates hold a PhD or are pursuing one with hands-on research, plus strong Python skills to run and modify analyses.