Content Analyst | $20/hr Remote

Crossing Hurdles; United States; On-site; USD 25,000 - 33,000; Part time

Job summary

Crossing Hurdles is seeking a Remote LLM AI Quality Analyst (Personalization) Japanese for a 4-month contract. You will create and evaluate prompts, assess personalization and accuracy, and ensure high‑quality AI interactions. This role requires strong Japanese writing and analytical thinking and offers flexible hours with an overlap with PST.

You will document evaluations, provide clear feedback, and follow data-handling guidelines while collaborating with the team in a fully remote setup.

Qualifications

• Strong Japanese proficiency, including reading and writing.
• Excellent analytical thinking and attention to detail.
• Ability to evaluate nuanced AI-generated responses.
• Strong written communication skills and ability to provide clear feedback.
• Ability to create and evaluate multi-turn prompts.
• Experience in AI evaluation, data annotation, content moderation, or related work is preferred.

Responsibilities

• Create and evaluate multi-turn prompts based on personal context and experiences.
• Assess AI responses for personalization, accuracy, relevance, and helpfulness.
• Review responses for unsupported assumptions, incorrect personalization, and other quality issues.
• Compare model responses and provide structured evaluations.
• Write clear rationales explaining evaluation decisions and observations.
• Review how relevant information is incorporated into responses.
• Follow project guidelines and maintain appropriate data-handling practices.

Skills

Japanese proficiency

Analytical thinking

Attention to detail

Feedback writing

Prompt engineering

AI evaluation experience

Job description

Role:LLM AI Quality Analyst (Personalization) Japanese

Type: Short-Term Contract (4 months)

Compensation: $20 per hour

Location: Remote

Commitment: Flexible 20 - 40 hrs/week with a minimum 4-hour overlap with PST

Role Responsibilities

• Create and evaluate multi-turn prompts based on personal context and experiences.


• Assess AI responses for personalization, accuracy, relevance, and helpfulness.


• Review responses for unsupported assumptions, incorrect personalization, and other quality issues.


• Compare model responses and provide structured evaluations.


• Write clear rationales explaining evaluation decisions and observations.


• Review how relevant information is incorporated into responses.


• Follow project guidelines and maintain appropriate data-handling practices.

Requirements

• Strong Japanese proficiency, including reading and writing.


• Excellent analytical thinking and attention to detail.


• Ability to evaluate nuanced AI-generated responses.


• Strong written communication skills and ability to provide clear feedback.


• Ability to create and evaluate multi-turn prompts.


• Experience in AI evaluation, data annotation, content moderation, or related work is preferred.