Remote AI Evaluation Specialist

micro1; United States; Remote; USD 34,000 - 83,000; Part time

Job summary

micro1 is a data lab that helps AI labs and enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM capabilities, as well as contextual evaluations to monitor and improve AI agents in enterprise settings.

Role: AI Product Evaluator (Contractor). You will evaluate AI models and agents, document findings in reports, and reset usage limits as required.

Qualifications

• Experience with AI products, AI models, or AI agent evaluation and testing.
• Demonstrated ability to follow complex instructions with precision and consistency.
• Exceptional attention to detail and operational thoroughness.
• Someone who already uses AI in daily life.

Responsibilities

• Evaluate AI models and agents according to detailed, pre-defined scenarios and guidelines.
• Execute a series of operational tasks designed to test model accuracy, reasoning, and responsiveness.
• Document findings, observations, and any anomalies in structured written reports.
• Reset usage limits and repeat evaluations as required by project protocols.
• Record findings and submit evaluation datasets on AI training platforms in line with project standards and milestones.
• Maintain a high standard of attention to detail and rigor across all evaluation tasks.

Skills

AI models

AI agents

Following instructions

Attention to detail

Job description

micro1 is a data lab that helps AI labs and enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM capabilities, as well as contextual evaluations to monitor and improve AI agents in enterprise settings.

Role: AI Product Evaluator (Contractor). You will evaluate AI models and agents, document findings in reports, and reset usage limits as required.