Remote Domain Evaluation Specialist

micro1; United States; Remote; USD 55,000 - 83,000; Part time

Job summary

micro1 is a data lab that helps AI labs and enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM capabilities, as well as contextual evaluations to monitor and improve AI agents in enterprise settings.

Role: Domain Contributor - Evaluation Specialist. This remote contractor position (~15 hrs/week) focuses on designing domain-specific tasks, evaluating outputs against authoritative sources, and documenting clear

Qualifications

• Domain depth
• Source verification
• Reasoning clarity
• Evaluation expertise

Responsibilities

• Design nuanced, domain-specific tasks that probe AI model limits and surface reasoning flaws.
• Author questions and scenarios demanding deep subject knowledge, beyond general understanding.
• Assess AI-generated outputs, validating accuracy against authoritative sources in your area of expertise.
• Document clear rationales for model shortcomings, specifying missed reasoning or source errors.
• Apply detailed task guidelines and evaluation rubrics consistently to each submission.
• Submit completed deliverables independently on a rolling basis, meeting project requirements for written and verbal clarity.

Skills

Domain depth

Source verification

Reasoning clarity

Evaluation expertise

Job description

micro1 is a data lab that helps AI labs and enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM capabilities, as well as contextual evaluations to monitor and improve AI agents in enterprise settings.

Role: Domain Contributor - Evaluation Specialist. This remote contractor position (~15 hrs/week) focuses on designing domain-specific tasks, evaluating outputs against authoritative sources, and documenting clear