Remote AI Quality Analyst — Personalization (Japanese)

Crossing Hurdles; United States; On-site; USD 25,000 - 30,000; Part time

Job summary

Crossing Hurdles is seeking a Remote LLM AI Quality Analyst (Personalization) with strong Japanese proficiency for a short-term contract (4 months). The role involves creating and evaluating multi-turn prompts, assessing personalization and accuracy of AI responses, and providing structured evaluations and clear feedback.

Flexible 20-40 hrs/week with PST overlap is required. compensation is $20 per hour, and the position emphasizes data-handling practices and adherence to project guidelines

Qualifications

• Strong Japanese proficiency, reading and writing.
• Excellent analytical thinking and attention to detail.
• Ability to evaluate nuanced AI-generated responses.
• Strong written communication skills and ability to provide clear feedback.
• Ability to create and evaluate multi-turn prompts.

Responsibilities

• Create and evaluate multi-turn prompts based on personal context and experiences.
• Assess AI responses for personalization, accuracy, relevance, and helpfulness.
• Review responses for unsupported assumptions, incorrect personalization, and other quality issues.
• Compare model responses and provide structured evaluations.
• Write clear rationales explaining evaluation decisions and observations.
• Review how relevant information is incorporated into responses.
• Follow project guidelines and maintain appropriate data-handling practices.

Skills

Japanese proficiency

Analytical thinking

Attention to detail

Written communication

Prompt evaluation

Job description

Crossing Hurdles is seeking a Remote LLM AI Quality Analyst (Personalization) with strong Japanese proficiency for a short-term contract (4 months). The role involves creating and evaluating multi-turn prompts, assessing personalization and accuracy of AI responses, and providing structured evaluations and clear feedback.

Flexible 20-40 hrs/week with PST overlap is required. compensation is $20 per hour, and the position emphasizes data-handling practices and adherence to project guidelines