AI Evaluation Data Analyst - Remote Contractor

Remotebridge; Northern (KY); Remote; USD 60,000 - 90,000; Full time

Job summary

Frontier AI Lab is seeking a Data Analyst (AI Evaluation) to review datasets and outputs for accuracy, applying strict rubrics to ensure quality. You will identify inconsistencies, document rationales, and escalate patterns for further analysis while maintaining meticulous attention to detail across high-volume data reviews.

The role is remote, US-based, and contract-type, focusing on producing reliable inputs to train AI systems.

Qualifications

• 3–5+ years experience in data review, QA or analytical roles.
• Strong ability to follow detailed written instructions and apply rubrics.
• Experience with data annotation, labeling, or rubric-based evaluation is a plus.

Responsibilities

• Review datasets and task outputs for accuracy and adherence to guidelines.
• Identify and flag inconsistencies, errors, and outputs that deviate from instructions.
• Apply structured rubrics and evaluation criteria across large data sets.

Skills

Data quality

QA

Data review

SQL

Spreadsheets

Tools

SQL

Excel

Job description

Frontier AI Lab is seeking a Data Analyst (AI Evaluation) to review datasets and outputs for accuracy, applying strict rubrics to ensure quality. You will identify inconsistencies, document rationales, and escalate patterns for further analysis while maintaining meticulous attention to detail across high-volume data reviews.

The role is remote, US-based, and contract-type, focusing on producing reliable inputs to train AI systems.