Remote AI Evaluation Specialist (English)

Executive Staff Recruiters / ESR Healthcare; United States; Remote; USD 60,000 - 90,000; Part time

Job summary

ESR Healthcare in the United States is seeking an English-speaking Generalist contractor to support AI model evaluation. You will create prompts, run tests, and document results by recording your screen and voice as you compare multiple models.

The role requires clear American English, attention to detail, and the ability to follow project guidelines. Prior experience with AI evaluation or data annotation is a plus.

Qualifications

• High-level fluency in spoken and written American English.
• Experience using large language models such as ChatGPT, Claude, Gemini.
• Familiarity with AI evaluation tasks.
• Comfortable recording screen and audio during sessions.

Responsibilities

• Create diverse prompts across topics to test language models.
• Submit identical prompts to both ChatGPT and Claude and record your screen and microphone during the process.
• Provide detailed, structured verbal feedback in clear American English, explaining your reasoning and preferences.
• Maintain clarity and professionalism in both spoken and written communication during each recording session.
• Interpret provided documentation to ensure consistent evaluation standards and accurate project delivery.
• Collaborate closely with project guidelines to support continuous improvement of AI models.

Skills

Fluent American English

Critical thinking

Analytical reasoning

Attention to detail

Clear communication

Tools

ChatGPT

Claude

Gemini

Job description

ESR Healthcare in the United States is seeking an English-speaking Generalist contractor to support AI model evaluation. You will create prompts, run tests, and document results by recording your screen and voice as you compare multiple models.

The role requires clear American English, attention to detail, and the ability to follow project guidelines. Prior experience with AI evaluation or data annotation is a plus.