Remote Danish AI Evaluation Analyst (Contractor)

AuraOne Human Data

United States

Remote

USD 28,000 - 48,000

Part time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

AuraOne Human Data is seeking a Danish-Language Business Analyst, AI Evaluation, as a remote contractor in the United States. You will review model outputs, apply the versioned rubric, assign severity tags, and craft structured feedback for retraining and improvement.

The role emphasizes careful labeling, cross-checking with paired responses, and identifying edge cases. This position requires clear written reasoning, attention to detail, and the ability to work asynchronously for at least 10

Qualifications

  • Proven experience evaluating model outputs with structured rubrics.
  • Ability to apply rubrics consistently across long batches.
  • Skill in tagging and labeling outputs by severity and category.
  • Experience calibrating ratings against gold-standard exemplars.

Responsibilities

  • Evaluate business analyst evaluation model outputs against a versioned rubric and assign severity tags.
  • Compare paired responses and select the stronger answer with a written rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them back to the program team for rubric updates.
  • Maintain reviewer-quality scores by calibrating against gold-standard examples weekly.
  • Document recurring failure modes so the modeling team can target them in the next training run.

Skills

Model output evaluation
Rubric-based annotation
Severity tagging
Inter-rater calibration
Business Analyst evaluation
Critical Thinking
Business Analysis

Job description

AuraOne Human Data is seeking a Danish-Language Business Analyst, AI Evaluation, as a remote contractor in the United States. You will review model outputs, apply the versioned rubric, assign severity tags, and craft structured feedback for retraining and improvement.

The role emphasizes careful labeling, cross-checking with paired responses, and identifying edge cases. This position requires clear written reasoning, attention to detail, and the ability to work asynchronously for at least 10

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Danish Language Evaluation & QA Specialist
Remote Danish Language Evaluation & QA Specialist

AuraOne Human Data • United States

Remote
USD 45,000 - 65,000
Danish-Language Business Analyst, AI Evaluation
Danish-Language Business Analyst, AI Evaluation

AuraOne Human Data • United States

Remote
USD 28,000 - 48,000
Remote Danish Transcription Quality Evaluator
Remote Danish Transcription Quality Evaluator

Auraone • United States

Remote
USD 34,000 - 55,000
Remote Dutch AI Evaluation Analyst - Rubric & Feedback
Remote Dutch AI Evaluation Analyst - Rubric & Feedback

AuraOne Human Data • United States

Remote
USD 34,000 - 55,000
Swedish AI Evaluation Analyst (Remote) – Quality Review
Swedish AI Evaluation Analyst (Remote) – Quality Review

AuraOne Human Data • United States

Remote
USD 41,000 - 76,000
Finnish AI Evaluation Analyst (Remote Contractor)
Finnish AI Evaluation Analyst (Remote Contractor)

AuraOne Human Data • United States

Remote
USD 34,000 - 55,000
Remote Norwegian QA Analyst — Model Evaluation & Feedback
Remote Norwegian QA Analyst — Model Evaluation & Feedback

AuraOne, Inc. • United States

Remote
USD 34,000 - 69,000
Danish Transcription Expert
Danish Transcription Expert

Auraone • United States

Remote
USD 34,000 - 55,000
Remote Danish–English Business Analyst for AI Insights
Remote Danish–English Business Analyst for AI Insights

Turing • United States

Remote
USD 34,000 - 69,000
Work in a fully remote environment
Work on cutting-edge AI projects
Contract extension potential
German AI Model Review Analyst (Remote)
German AI Model Review Analyst (Remote)

AuraOne Human Data • United States

Remote
USD 55,000 - 96,000