Data Integrity Benchmark Architect

ixolabs.ai; France; Sur place; EUR 30 000 - 42 000; Plein temps

Résumé du poste

IXOCreate seeks to design evaluation tasks that test whether an AI system handles demanding data-entry and reconciliation work correctly. You will assemble data from diverse sources, create credible errors, and specify exact corrections to reach a valid final state.

Deliverables include a complete benchmark package with inputs, task instructions, expected outcomes and a detailed scoring rubric. Prior AI experience is not required; strong documentation and remote collaboration are essential.

Qualifications

• Must have strong data entry and QA experience in regulated or audit-sensitive contexts.
• Ability to document decisions and explain changes clearly.
• Excellent written English with precise attention to file-level details.

Responsabilités

• Assemble complex datasets from CSV files, PDFs, spreadsheets and technical documents.
• Introduce credible test cases such as malformed records, missing values, inconsistent formats and silent truncation.
• Specify the correct final state and precise corrections needed to reach it.
• Write a detailed scoring rubric with at least 35 criteria for accuracy and error detection.
• Reproduce care expected in regulated processes without private data.
• Revise task packages after review and explain the rationale for changes.

Connaissances

Data entry

Quality assurance

Validation

Attention to detail

Written English

Description du poste

IXOCreate seeks to design evaluation tasks that test whether an AI system handles demanding data-entry and reconciliation work correctly. You will assemble data from diverse sources, create credible errors, and specify exact corrections to reach a valid final state.

Deliverables include a complete benchmark package with inputs, task instructions, expected outcomes and a detailed scoring rubric. Prior AI experience is not required; strong documentation and remote collaboration are essential.