Remote AI Evaluation Engineer — Business Analysis Prompts

OpenTrain AI, Inc.; United States; Remote; USD 41,000 - 83,000; Part time

Benefits offered by this job

Remote work

Per-task payment

Job summary

OpenTrain AI, Inc. is seeking a Tooling Engineer focused on Business Analysis and AI evaluation. The role is remote and part-time, requiring a master’s degree and at least three years of experience.

Applicants will craft challenging prompts, test model responses, and provide detailed, evidence-based feedback to improve AI performance. You will evaluate language models used for business-analysis tasks, ensure factual accuracy, and identify weaknesses through rigorous testing and edge cases.

Qualifications

• Master's degree or higher in a relevant field.
• At least three years of professional, research, or teaching experience.
• Part-time remote contract requiring 20+ hours per week.
• Ability to write demanding prompts, test edge cases, and review AI responses.
• Provide evidence-based feedback and communicate findings clearly.

Responsibilities

• Write complex business-analysis prompts to test language-model capabilities.
• Review AI-generated responses for factual accuracy and reasoning quality.
• Identify factual errors, logical gaps, and knowledge gaps.
• Create difficult test cases to expose limits in model performance.

Skills

Business-analysis

Analytical thinking

Critical thinking

Education

Master's degree or higher in a relevant field

Job description

OpenTrain AI, Inc. is seeking a Tooling Engineer focused on Business Analysis and AI evaluation. The role is remote and part-time, requiring a master’s degree and at least three years of experience.

Applicants will craft challenging prompts, test model responses, and provide detailed, evidence-based feedback to improve AI performance. You will evaluate language models used for business-analysis tasks, ensure factual accuracy, and identify weaknesses through rigorous testing and edge cases.