Turkish AI Output Reviewer & Rubric Specialist (Remote)

AuraOne Human Data

United States

Remote

USD 28.000 - 50.000

Vollzeit

Vor 2 Tagen
Sei unter den ersten Bewerbenden

Eine vollständige Bewerbung in einer Minute

Maßgeschneiderter Lebenslauf und Anschreiben – versandbereit.

Schaffe es an den ATS-Filtern vorbei

Zusammenfassung

AuraOne Human Data is seeking a Turkish-Language Business Analyst to perform AI output review tasks remotely. You will evaluate model outputs, apply a versioned rubric, and provide structured feedback to improve training data.

The role emphasizes meticulous reasoning, edge-case labeling, and consistent rubric application. As a contractor able to work asynchronously, you will review paired responses, assign severity tags, and help calibrate cross-batch quality.

Qualifikationen

  • Prior evaluation, annotation, or human-rater experience on turkish generalist evaluation or adjacent content for Turkish-Language Business Analyst | AI Output Review work.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that names the issue and the rubric clause being applied.
  • Strong attention to detail and the ability to flag when a prompt itself is the problem.
  • Reliable async availability for at least 10 hours per week.

Aufgaben

  • Evaluate turkish generalist evaluation model outputs against a versioned rubric and assign severity tags for Turkish-Language Business Analyst | AI Output Review assignments.
  • Compare paired responses and pick the stronger answer with a written rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them back to the program team for rubric updates.
  • Maintain reviewer-quality scores by calibrating against gold-standard examples each week.
  • Document recurring failure modes so the modeling team can target them in the next training run.

Kenntnisse

Model output evaluation
Rubric-based annotation
Severity tagging
Inter-rater calibration
Turkish generalist evaluation
Critical Thinking
Business Analysis

Jobbeschreibung

AuraOne Human Data is seeking a Turkish-Language Business Analyst to perform AI output review tasks remotely. You will evaluate model outputs, apply a versioned rubric, and provide structured feedback to improve training data.

The role emphasizes meticulous reasoning, edge-case labeling, and consistent rubric application. As a contractor able to work asynchronously, you will review paired responses, assign severity tags, and help calibrate cross-batch quality.

Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Turkish-Language Business Analyst | AI Output Review
Turkish-Language Business Analyst | AI Output Review

AuraOne Human Data • USA

Remote
USD 28.000 - 50.000
Turkish Evaluation Specialist - Remote Quality Assurance
Turkish Evaluation Specialist - Remote Quality Assurance

Auraone • USA

Remote
USD 34.000 - 55.000
Remote AI Quality Analyst – Turkish Personalization
Remote AI Quality Analyst – Turkish Personalization

AuraOne Human Data • USA

Remote
USD 17.000 - 24.000
Remote Turkish Linguistics QA and Policy Specialist
Remote Turkish Linguistics QA and Policy Specialist

AuraOne Human Data • USA

Remote
USD 57.000 - 81.000
Turkish Linguistic Experts
Turkish Linguistic Experts

AuraOne Human Data • USA

Remote
USD 57.000 - 81.000
Arabic AI Evaluation Analyst — Remote Contractor
Arabic AI Evaluation Analyst — Remote Contractor

AuraOne Human Data • USA

Remote
USD 28.000 - 55.000
AI Quality Analyst (Personalization) - Turkish
AI Quality Analyst (Personalization) - Turkish

AuraOne Human Data • USA

Remote
USD 17.000 - 24.000
Turkish Language Expert
Turkish Language Expert

Auraone • USA

Remote
USD 34.000 - 55.000
Remote Dutch AI Evaluation Analyst - Rubric & Feedback
Remote Dutch AI Evaluation Analyst - Rubric & Feedback

AuraOne Human Data • USA

Remote
USD 34.000 - 55.000
Remote AI Evaluation Rubric Reviewer & Feedback Specialist
Remote AI Evaluation Rubric Reviewer & Feedback Specialist

AuraOne Human Data • USA

Remote
USD 34.000 - 55.000