In-House Counsel: AI Benchmarks & Evaluation (AU)

aitrainer; Australia; On-site; AUD 195,000 - 234,000; Full time

Job summary

Mercor, partnering with a leading legal AI company, is seeking experienced in-house counsel to serve as expert reviewers. You will run the same prompts through two AI platforms, compare the outputs side by side, and score each response against a standardized rubric we provide.

The role requires 5+ years as in-house counsel practising in Australia, strong command of commercial and contract matters, and precise written English.

Qualifications

• 5+ years as in-house legal counsel practising in Australia.
• Strong command of Australian law, especially commercial and contract matters.
• Sharp attention to detail and precise written English.
• Able to work independently to a rubric and to deadlines.

Responsibilities

• Run the same set of prompts across two AI platforms.
• Compare outputs from both platforms side by side.
• Score each response against a standardized rubric provided.
• Submit concise written feedback for every evaluation.

Skills

In-house counsel

Australian law

Attention to detail

Written English

Independent work

Deadline-driven

Job description

Mercor, partnering with a leading legal AI company, is seeking experienced in-house counsel to serve as expert reviewers. You will run the same prompts through two AI platforms, compare the outputs side by side, and score each response against a standardized rubric we provide.

The role requires 5+ years as in-house counsel practising in Australia, strong command of commercial and contract matters, and precise written English.