German Law Expert - In-House Counsel

Obsidian; Berlin; Vor Ort; EUR 60.000 - 90.000; Teilzeit

Zusammenfassung

Obsidian in Berlin seeks experienced in-house counsel to act as expert reviewers for benchmarking how AI systems answer questions of German law. You will run prompts on two AI platforms, compare results, and score them against a standardized rubric while providing concise written feedback. NDA covers all work.

The role requires 5+ years as in-house counsel in Germany, strong knowledge of commercial and contract law, and the ability to work independently to strict deadlines.

Qualifikationen

• 5+ years as in-house legal counsel practising in Germany.
• Strong command of German commercial and contract law.
• Attention to detail and precise written communication.
• Ability to work independently to a rubric and deadlines.

Aufgaben

• Run the same prompts across two AI (LLM) platforms.
• Compare the outputs from both platforms side by side.
• Score each response against a standardized rubric we provide.
• Submit concise written feedback for every evaluation.

Kenntnisse

German law

Commercial law

Contract law

Independent work

Jobbeschreibung

Mercor is partnering with a leading legal AI company to benchmark how well AI systems answer real questions of German law. We are hiring experienced in-house counsel to serve as expert reviewers — running the same prompts through two AI platforms, comparing the answers and scoring them against a standardized rubric.

What you'll do

• Run the same set of prompts across two AI (LLM) platforms
• Compare the outputs from both platforms side by side
• Score each response against a standardized rubric we provide
• Submit concise written feedback for every evaluation

Requirements

• 5+ years as in-house legal counsel practising in Germany
• Strong command of German law, especially commercial and contract matters
• Sharp attention to detail and precise written communication
• Able to work independently to a rubric and to deadlines

Logistics

• Initial commitment: ~10 hours, with strong potential for more
• Confidentiality: all work is covered by NDA