Data Analyst (AI Evaluation) | $30–60/hr

Codefeast; United States; Sur place; USD 60 000 - 90 000; Plein temps

Résumé du poste

Codefeast is seeking a Data QA reviewer to help shape AI training data by reviewing datasets and task outputs against detailed rubrics. You will apply sound judgment in ambiguous scenarios and provide clear, actionable feedback to improve data quality.

No prior AI experience required; candidates should have strong attention to detail and excellent written and verbal communication skills to work effectively with cross-functional teams.

Qualifications

• 3–5+ years in data review, data quality, QA, or analytical roles.
• Strong ability to follow detailed instructions and apply evaluation rubrics precisely.
• Comfortable making justifiable decisions with incomplete guidelines.
• Advanced attention to detail across high-volume, repetitive work.
• Strong written and verbal communication skills.

Responsabilités

• Review datasets and task outputs for accuracy, completeness, and guideline adherence.
• Flag inconsistencies, errors, and deviations from instructions.
• Apply structured rubrics consistently across large datasets.
• Escalate recurring data issues for further analysis.
• Provide clear, actionable feedback on issues and resolutions.

Connaissances

Data quality review

Attention to detail

Instruction following

Written and verbal communication

Data annotation/rubric evaluation

Outils

SQL

Spreadsheet fluency

Description du poste

Review datasets and task outputs against detailed rubrics for an AI training and data quality project. Apply sound judgment in ambiguous scenarios and help shape how AI models learn through high-quality data review. No prior AI experience required.

Key Responsibilities

• Review datasets and task outputs for accuracy, completeness, and guideline adherence.
• Flag inconsistencies, errors, and deviations from instructions.
• Apply structured rubrics consistently across large datasets.
• Escalate recurring data issues for further analysis.
• Provide clear, actionable feedback on issues and resolutions.

Key Requirements

• 3–5+ years in data review, data quality, QA, or analytical roles.
• Strong ability to follow detailed instructions and apply evaluation rubrics precisely.
• Comfortable making justifiable decisions with incomplete guidelines.
• Advanced attention to detail across high-volume, repetitive work.
• Strong written and verbal communication skills.
• Spreadsheet fluency; SQL or data querying experience is a plus.
• Data annotation or rubric-based evaluation experience is advantageous.