Data Analyst (AI Evaluation)

Remolity, Inc.; Northern (KY); Hybrid; USD 60,000 - 90,000; Full time

Benefits offered by this job

Special Referral

Job summary

Remolity, Inc. is seeking a Data Analyst (AI Evaluation) to support a US-based, remote data quality project. You will review datasets, assess outputs against guidelines, and provide precise feedback to improve AI model training.

The role emphasizes domain knowledge over prior AI experience, with a focus on accuracy and detail. Responsibilities include identifying inconsistencies, applying rubrics, and documenting rationale for ambiguous cases while handling large volumes of tasks.

Qualifications

• 3–5+ years in data review, data quality, quality assurance, or analytical roles.
• Proven ability to review, validate, and critique data or deliverables against explicit criteria.
• Excellent ability to follow detailed written instructions and apply evaluation rubrics precisely.
• Comfort with ambiguity and making justifiable decisions when guidelines are incomplete.
• High attention to detail and strong error-spotting across repetitive tasks.
• Strong written and verbal communication for documenting findings and providing feedback.
• Baseline fluency with spreadsheets; SQL or data querying is a plus.
• Experience with data annotation, labeling, or rubric-based evaluation is advantageous.

Responsibilities

• Review datasets and task outputs for accuracy, completeness, and guideline adherence.
• Identify and flag inconsistencies, errors, and outputs deviating from instructions.
• Apply structured rubrics and evaluation criteria across large data sets.
• Exercise judgment and document rationale in ambiguous scenarios.
• Escalate recurring data issues for further analysis, not just isolated fixes.
• Provide clear, actionable written and verbal feedback with resolution paths.
• Maintain meticulous attention to detail during high-volume data review assignments.

Skills

Data review

Data quality

Quality assurance

Analytical

Attention to detail

Communication

Spreadsheets

SQL

Data annotation

Job description

Data Analyst (AI Evaluation)

Remote — United States

Data analysis Data review Attention to detail Handling ambiguity Error spotting

Special Referral gives your application an enhanced referral route, helping it stand out and potentially improving your chances of being considered.

About the role

micro1 is engaging Data Analysts to contribute their knowledge and expertise to a customer's data quality project. In this role, you will help train next-generation AI systems through high-quality, real-world input that shapes how models learn, reason, and perform. No prior experience in AI is required — your domain knowledge is what matters.

Scope of Work

• Review datasets and detailed task outputs for accuracy, completeness, and adherence to guidelines.
• Identify and flag inconsistencies, errors, and outputs that deviate from provided instructions.
• Apply structured rubrics and evaluation criteria consistently across large data sets.
• Exercise sound judgment and document rationale in ambiguous scenarios where guidelines are unclear.
• Escalate patterns or recurring data issues for further analysis rather than addressing them individually.
• Provide clear, actionable written and verbal feedback pinpointing issues and suggesting resolution paths.
• Maintain meticulous attention to detail while working through high volumes of repetitive data review assignments.

Preferred Qualifications

• 3–5+ years of experience in data review, data quality, quality assurance, or analytical roles.
• Proven expertise in reviewing, validating, and critiquing data or deliverables based on explicit criteria.
• Exceptional ability to follow detailed written instructions and apply complex evaluation rubrics precisely.
• Demonstrated comfort with ambiguity, including making justifiable decisions when guidelines are incomplete.
• Advanced attention to detail and error-spotting capabilities across repetitive or high-volume work.
• Strong written and verbal communication skills for documenting findings and providing feedback.
• Baseline fluency with spreadsheets (sorting, filtering, simple formulas); SQL or hands‑on data querying is a plus.
• Experience with data annotation, labeling, or rubric-based evaluation is advantageous.

Benefits

Not provided in the source listing.

Where you can work

This role is open to people based in: United States.

Remote does not always mean work from any country. Always check the employer’s location and working‑hour requirements.