Legal & Compliance Benchmark Architect (Remote)

Synthires; California; Remote; USD 102,000 - 146,000; Part time

Benefits offered by this job

Fully remote

Project-based engagement

Job summary

Synthires is seeking experienced legal and compliance professionals to design realistic, multi-step benchmark tasks for evaluating AI systems. You will apply contract review, due diligence, regulatory compliance, and risk analysis to craft clearly defined, gradable challenges.

Role emphasizes sound professional judgment over simple lookups. Remote, project-based engagement with compensation up to $90 per hour, approx. 10 hours per task, and independent work within timelines.

Qualifications

• At least five years of hands-on experience in contract review, due diligence, regulatory compliance, risk analysis.
• Direct responsibility for performing the work, not just supervisory exposure.
• Experience interpreting legal documents and regulatory materials.
• Strong analytical reasoning and ability to spot inconsistencies across documents.
• Excellent written and spoken English (B2, C1 preferred).

Responsibilities

• Design multi-step tasks based on real legal and compliance workflows, including contract review, due diligence, regulatory assessment, and risk analysis.
• Develop realistic task instructions and provide relevant reference materials, such as agreements, policy documents, regulatory texts, and due diligence files.
• Define objective grading criteria that enable qualified reviewers to evaluate outputs consistently.
• Create tasks that assess legal judgment, document interpretation, and the ability to resolve conflicting requirements.
• Identify inconsistencies, ambiguities, and substantive issues across multiple documents.
• Ensure each task is clearly defined, sufficiently challenging, and objectively gradable.
• Flag tasks that are ambiguous or cannot be graded reliably rather than submitting them for approval.
• Deliver approved tasks on schedule while maintaining the required quality standards.

Skills

Contract review

Due diligence

Regulatory compliance

Risk analysis

Analytical reasoning

English proficiency

Education

Law degree or equivalent

Job description

Synthires is seeking experienced legal and compliance professionals to design realistic, multi-step benchmark tasks for evaluating AI systems. You will apply contract review, due diligence, regulatory compliance, and risk analysis to craft clearly defined, gradable challenges.

Role emphasizes sound professional judgment over simple lookups. Remote, project-based engagement with compensation up to $90 per hour, approx. 10 hours per task, and independent work within timelines.