Remote Legal Specialist for AI Evaluation Tasks

Patronus AI; United States; Remote; USD 69,000 - 207,000; Full time

Job summary

Patronus AI is a frontier lab developing simulation research and infrastructure to accelerate progress toward human-aligned AGI. The role involves building realistic legal evaluation tasks, drafting requests, solving end-to-end, and defining scoring rubrics.

You will contribute to frontier model evaluation data from practitioner perspectives while working asynchronously from a remote US-based setup. No AI background is required, but you must be a careful legal professional who examines

Qualifications

• 3+ years of hands-on experience in at least one of the areas above as an attorney, patent or trademark agent, or IP paralegal.
• Working knowledge of the rules, procedures and documentation standards in your area (e.g., court rules, discovery practice, closing mechanics, deal docs, USPTO rules).
• Clear, precise writing in professional English.

Responsibilities

• Build realistic evidence files from provided scenarios and documents.
• Write task requests with deliverables and handling of uncertainties.
• Solve tasks end to end and document a reference solution with reasoning.
• Write precise scoring criteria for graders and include acceptable alternatives.
• Check tasks for legal accuracy and ambiguity.
• Work with the team in reviewer feedback and adhere to turnaround times.
• Explain to the research team how work is actually done, including steps and documents.
• Review scenarios and documents for realism from practitioners' perspective.

Skills

Legal research

Legal writing

Independent work

Asynchronous work

Attention to detail

English proficiency

Job description

Patronus AI is a frontier lab developing simulation research and infrastructure to accelerate progress toward human-aligned AGI. The role involves building realistic legal evaluation tasks, drafting requests, solving end-to-end, and defining scoring rubrics.

You will contribute to frontier model evaluation data from practitioner perspectives while working asynchronously from a remote US-based setup. No AI background is required, but you must be a careful legal professional who examines