Remote AI Evaluation & Prompt Specialist

ESR Healthcare; Los Angeles (CA); On-site; USD 34,000 - 69,000; Full time

Job summary

ESR Healthcare is seeking an English Speaking Generalist contractor to support AI evaluation projects remotely. You will create diverse prompts to stress-test large language models, run parallel prompts on ChatGPT and Claude, and document your screen and voice recordings during sessions.

You'll articulate clear, structured feedback in American English, describing strengths, weaknesses, and key differences.

Qualifications

• Fluent American English, spoken and written.
• Experience evaluating AI models and providing structured feedback.
• Comfortable recording sessions for extended evaluation tasks.

Responsibilities

• Create prompts to challenge large language models.
• Submit identical prompts to ChatGPT and Claude and record sessions.
• Provide clear, structured feedback in American English highlighting strengths, weaknesses and differences.
• Interpret documentation to ensure consistent evaluation.
• Collaborate with guidelines to support model improvements.

Skills

American English fluency

Experience with LLMs

AI evaluation tasks

Recording setup

Tools

ChatGPT

Claude

Gemini

Job description

ESR Healthcare is seeking an English Speaking Generalist contractor to support AI evaluation projects remotely. You will create diverse prompts to stress-test large language models, run parallel prompts on ChatGPT and Claude, and document your screen and voice recordings during sessions.

You'll articulate clear, structured feedback in American English, describing strengths, weaknesses, and key differences.