Research Evaluation Specialist (PhD / Researcher / Professor)

Executive Staff Recruiters / ESR Healthcare; Deutschland; Remote; EUR 33.000 - 78.000; Teilzeit

Zusammenfassung

ESR Healthcare seeks a Research Evaluation Specialist (PhD / Researcher / Professor) for a remote contractor role. You will create advanced QA pairs to test AI models, source and cite primary references, and craft rigorous, defensible answers with precision.

Applicants should have a PhD or active candidacy, a track record in scholarly research, strong analytical and written English skills, and the ability to work independently in a remote setting while meeting minimum weekly task submissions.

Qualifikationen

• PhD or equivalent research experience in your domain.
• Strong scholarly research background and familiarity with primary literature.
• Excellent analytical thinking, attention to detail, and English writing.
• Experience sourcing and triangulating information from authoritative references.
• Self-directed and reliable for remote engagements.
• Ability to compose challenging, original, methodologically sound questions.

Aufgaben

• Create high-difficulty QA pairs to assess AI model capabilities.
• Source, verify, and document answers with primary sources and citations.
• Design questions requiring advanced reasoning and cross-source synthesis.
• Test questions with AI systems and iterate for higher complexity while maintaining accuracy.
• Write questions and answers with precision and clarity; minimize ambiguity.
• Incorporate reviewer feedback and uphold project guidelines and quality standards.

Kenntnisse

Analytical thinking

Written communication

Sourcing information

Independent remote work

Question design

AI evaluation experience

Ausbildung

PhD / active candidacy or equivalent research experience

Jobbeschreibung

Research Evaluation Specialist (PhD / Researcher / Professor)

Role Type: Contractor

Location: Remote

Scope of Work

• Create original, high-difficulty question-and-answer pairs at the cutting edge of your discipline to rigorously assess AI model capabilities.
• Source, verify, and thoroughly document answers using primary sources and authoritative references, including clear citations and reasoning.
• Design questions demanding advanced reasoning, methodological nuance, or synthesis across multiple sources, ensuring resistance to oversimplified or shortcut solutions.
• Test questions against AI systems, identify items that are not sufficiently challenging, and iteratively increase complexity while maintaining accuracy.
• Write each question and answer with high precision and clarity, eliminating ambiguity and supporting defensible responses.
• Integrate reviewer feedback and consistently uphold all project guidelines and quality standards throughout your deliverables.

Preferred Qualifications

• PhD completed, active candidacy, or equivalent research experience as a specialist, researcher, or professor in your domain.
• Demonstrated track record of scholarly research, in-depth subject matter expertise, and familiarity with primary literature.
• Exceptional analytical thinking, close attention to detail, and strong written communication skills in English.
• Experience sourcing and triangulating information from authoritative references.
• Proven self-direction and reliability in delivering expert‑level work independently within remote engagements.
• Skill in composing challenging, original, and methodologically sound questions.
• Experience in AI training or evaluation is advantageous but not required.

Compensation Structure

Compensation is output-based; experts are paid per task that meets the project specifications. The time required to complete work may vary depending on the expert’s experience and workflow. Minimum submission requirements apply. Experts must submit a minimum of tasks per week.

Start Timeline & Availability

We typically fill roles within 48 hours and are looking for experts ready to jump in right away. If selected, we expect you to start your first tasks within 24–48 hours of completing onboarding.