Turing is seeking an AI Quality Analyst based in the Netherlands to evaluate a new personalization feature. The role necessitates Dutch proficiency and involves designing prompts, analyzing AI responses, and providing feedback. Candidates should have relevant educational backgrounds and excellent analytical skills. This contractor position requires availability for up to 40 hours a week. Turing offers a competitive rate of $15 per hour and encourages independent work in a remote setting.
Responsibilities
Design and execute multi-turn conversational prompts based on personal information.
Evaluate model responses for appropriate personalization.
Analyze responses for Grounding issues and evidence support.
Assess Integration quality to ensure natural weaving of personal data.
Rank two model responses side-by-side for overall helpfulness.
Write clear rationales for comparisons, referencing specific issues.
Verify 'Debug Info' from the model regarding chat summaries.
Maintain strict data hygiene by deleting evaluation conversations.
Skills
Dutch Proficiency
Exceptional Analytical Thinking
Creative Prompt Engineering
Strong Evaluation Acumen
Meticulous Attention to Detail
Excellent Written Communication
Feedback
Communication
Independence
Technical Setup
Education
BS/BA degree in relevant field
Job description
Turing is seeking an AI Quality Analyst based in the Netherlands to evaluate a new personalization feature. The role necessitates Dutch proficiency and involves designing prompts, analyzing AI responses, and providing feedback. Candidates should have relevant educational backgrounds and excellent analytical skills. This contractor position requires availability for up to 40 hours a week. Turing offers a competitive rate of $15 per hour and encourages independent work in a remote setting.