AI Evaluation & Research Analyst (Freelance)

OpenTrain AI, Inc.; United States; A distancia; USD 28.000 - 55.000; A tiempo parcial

Ventajas ofrecidas por este puesto de trabajo

Part-time contractor

Descripción de la vacante

OpenTrain AI, Inc. is seeking an entry-level contractor to evaluate how AI agents understand instructions, analyze information, reason through problems, and complete tasks in digital environments.

You will review AI-generated responses, perform online verification, and create evaluation scenarios for quality assessment. The role requires strong English communication, analytical thinking, and the ability to work 20+ hours weekly as a remote contractor.

Formación

• Review AI-generated responses for accuracy and task completion.
• Verify claims through online research and evidence evaluation.
• Solve analytical, data interpretation, arithmetic, and puzzle-based questions.
• Create questions and scenarios for evaluating LLM performance.
• Write clear annotations and explanations about response quality and errors.

Responsabilidades

• Review AI responses and actions for accuracy and task completion.
• Verify claims through online research and assess supporting evidence.
• Solve logical reasoning, data interpretation, arithmetic, and puzzle-based questions.
• Create questions and scenarios for evaluating large language model performance.
• Write clear annotations and explanations about response quality and errors.

Conocimientos

Strong English communication

Analytical reasoning

Research

Data interpretation

Critical thinking

Creative reasoning

Educación

Study in engineering, literature, journalism, communications, arts, statistics, business or related discipline welcome

Herramientas

Excel

Google Sheets

Google Docs

Google Workspace

Descripción del empleo

OpenTrain AI, Inc. is seeking an entry-level contractor to evaluate how AI agents understand instructions, analyze information, reason through problems, and complete tasks in digital environments.

You will review AI-generated responses, perform online verification, and create evaluation scenarios for quality assessment. The role requires strong English communication, analytical thinking, and the ability to work 20+ hours weekly as a remote contractor.