Remote AI Compliance Benchmark Designer

Synthires; United States; Remote; USD 102,000 - 146,000; Part time

Benefits offered by this job

Fully remote

Job summary

Synthires seeks experienced legal and compliance practitioners to design realistic, multi-step benchmark tasks that test AI systems against objective criteria. You will translate real-world workflows—contracts, due diligence, regulatory reviews—into clearly defined tasks with reference materials and rigorous grading rubrics.

This remote, contractor engagement offers competitive compensation up to $90 per hour and flexible scheduling.

Qualifications

• At least five years of hands-on contract review, due diligence, regulatory compliance, or risk analysis.
• Direct responsibility for performing the work, not just supervision.
• Experience interpreting legal documents, compliance requirements, and supporting materials.
• Strong analytical reasoning and ability to identify inconsistencies across documents.
• Excellent written and spoken English (B2 required, C1 preferred).
• Ability to work independently and deliver structured, high-quality tasks on schedule.

Responsibilities

• Design multi-step tasks based on real legal and compliance workflows.
• Develop task instructions and provide reference materials.
• Define objective grading criteria for consistent evaluation.
• Create tasks that assess legal judgment and document interpretation.
• Identify inconsistencies and substantive issues across documents.
• Ensure tasks are clearly defined, challenging, and gradable.
• Flag ambiguous tasks and avoid unusable items.
• Deliver approved tasks on schedule with quality standards.

Skills

Contract review

Due diligence

Regulatory compliance

Risk analysis

Analytical reasoning

English proficiency

Independent work

Education

Law degree or equivalent compliance qualification

Job description

Synthires seeks experienced legal and compliance practitioners to design realistic, multi-step benchmark tasks that test AI systems against objective criteria. You will translate real-world workflows—contracts, due diligence, regulatory reviews—into clearly defined tasks with reference materials and rigorous grading rubrics.

This remote, contractor engagement offers competitive compensation up to $90 per hour and flexible scheduling.