AI QA Analyst | $20/hr Remote

Crossing Hurdles; United States; On-site; USD 21,000 - 28,000; Part time

Job summary

Crossing Hurdles is seeking an LLM AI Quality Analyst (Personalization) Korean for a 4-month remote contract to help shape conversational experiences. You will review prompts, assess responses for relevance and naturalness, and provide concrete feedback to improve personalization strategies.

Bachelor's degree or equivalent in Linguistics, CS, or related field is preferred. Strong Korean reading and writing, sharp analytical skills, and clear written English are required to collaborate with

Qualifications

• Bachelor's degree or equivalent in a relevant field.
• Strong Korean reading and writing skills.
• Strong analytical skills and attention to detail.
• Ability to evaluate nuanced written responses objectively.
• Good written English and the ability to explain decisions clearly.

Responsibilities

• Create and review conversational prompts based on personal context.
• Assess responses for relevance, accuracy, naturalness, and appropriate use of context.
• Compare responses side by side and determine which provides the better experience.
• Identify unsupported assumptions, inaccurate information, awkward responses, and other quality issues.
• Provide clear explanations and feedback to support consistent evaluations.
• Follow project guidelines and maintain high-quality review standards.

Skills

Korean reading

Analytical skills

Attention to detail

Clear written English

Education

Bachelor's degree or equivalent in Linguistics, Journalism, Computer Science, Policy, Law, Ethics, or related field

Job description

Position: LLM AI Quality Analyst (Personalization) Korean

Type: Short-Term Contract (4 Months)

Compensation: $15 $20/hour

Location: Remote

Commitment: Flexible, up to 40 hours/week with a minimum 4-hour PST overlap

Role Responsibilities

• Create and review conversational prompts based on personal context.
• Assess responses for relevance, accuracy, naturalness, and appropriate use of context.
• Compare responses side by side and determine which provides the better experience.
• Identify unsupported assumptions, inaccurate information, awkward responses, and other quality issues.
• Provide clear explanations and feedback to support consistent evaluations.
• Follow project guidelines and maintain high-quality review standards.

Requirements

• 1+ year of experience in content review, data annotation, quality evaluation, or a related analytical role is preferred.
• Strong Korean reading and writing skills.
• Strong analytical skills and attention to detail.
• Ability to evaluate nuanced written responses objectively.
• Good written English and the ability to explain decisions clearly.
• Bachelor's degree or equivalent experience in Linguistics, Journalism, Computer Science, Policy, Law, Ethics, or a related field.

Application Process

• Shortlisted candidates will receive information about the next steps.