Senior AI Trainer: Prompt Quality & Evaluation

Appsierra Group; Österreich; Vor Ort; EUR 24.000 - 61.000; Vollzeit

Benefits dieser Stelle

Remote work

Zusammenfassung

Appsierra Group is seeking Senior AI Trainer to evaluate and improve AI chat and search systems from a remote location across North America and Europe. The role emphasizes careful evaluation, prompt development, and structured feedback to enhance model performance and reliability.

Candidates should demonstrate strong communication, meticulous attention to detail, and excellent self-organization for a contractor, remote work arrangement with payment via hourly or annualized compensation depending

Qualifikationen

• Exceptional attention to detail and accuracy when reviewing AI-generated content.
• Strong written and verbal communication skills.
• Excellent time management and self-organization for remote work.
• Analytical and problem-solving ability.
• Ability to apply detailed guidelines consistently and identify subtle quality issues.
• Ability to explain evaluation decisions clearly and constructively.

Aufgaben

• Evaluate AI chat and search tools under standardized and repeatable conditions.
• Apply detailed grading guidelines to evaluate, rank, and annotate AI-generated responses.
• Provide structured feedback to improve model accuracy, helpfulness, and overall performance.
• Write, refine, and stress-test prompts covering diverse scenarios, edge cases, and user intents.
• Verify consistency and accuracy across evaluations and correct discrepancies between ratings and established guidelines.
• Use AI training and evaluation platforms to record findings and submit evaluation datasets.
• Collaborate with project trainers and contributors to resolve ambiguities and improve evaluation guidelines.
• Participate in ongoing quality reviews and incorporate feedback to maintain consistent annotation standards.
• Work independently while meeting project requirements, quality standards, and deadlines.

Kenntnisse

Attention to detail

Written communication

Verbal communication

Time management

Analytical thinking

Problem solving

Guideline adherence

Evaluation explanation

Jobbeschreibung

Appsierra Group is seeking Senior AI Trainer to evaluate and improve AI chat and search systems from a remote location across North America and Europe. The role emphasizes careful evaluation, prompt development, and structured feedback to enhance model performance and reliability.

Candidates should demonstrate strong communication, meticulous attention to detail, and excellent self-organization for a contractor, remote work arrangement with payment via hourly or annualized compensation depending