Legal Experts to train LLM's (multiple positions)

DeepLLMData; United States; On-site; USD 85,000 - 125,000; Full time

Job summary

DeepLLMData seeks experienced Legal Professionals / Paralegals to design, develop, and evaluate prompts for Large Language Models using real-world legal documents and frameworks. This role blends legal expertise with AI prompt engineering and response validation.

You will craft prompts covering contracts, case law, statutes, and compliance, while building golden outputs and validating model accuracy across jurisdictions.

Qualifications

• 4–10 years of experience in Legal / Paralegal / Compliance roles.
• Strong analytical and critical thinking skills to evaluate AI-generated legal outputs.

Responsibilities

• Design, develop, and evaluate high-quality prompts for LLMs using real-world legal documents.
• Create legal-domain prompts: contracts, case law, statutes, compliance documents.
• Develop “Golden Responses” as benchmarks for model evaluation.
• Test prompts across leading LLMs for legal accuracy, reasoning, and jurisdiction alignment.
• Perform risk identification and compliance considerations in prompt design.

Skills

Legal experience

Analytical thinking

Paralegal exposure

Job description

DeepLLMData specializes in powering frontier machine learning and AI models with high-quality expert human data. Our offerings include expertise in Structured Fine-Tuning (SFT) and Reinforcement Learning with Human Feedback (RLHF), as well as support for STEM, Domains, mathematics, and various industry-specific areas.

Role Description

We are seeking experienced Legal Professionals / Paralegals to design, develop, and evaluate high-quality prompts for Large Language Models (LLMs) using real-world legal documents and frameworks. This role combines legal expertise with AI prompt engineering and response validation.

• Create legal-domain prompts using structured and unstructured legal content such as:
• Contracts and agreements (NDAs, MSAs, SLAs, employment contracts)
• Case law and legal precedents
• Statutes, regulations, and compliance documents
• Legal opinions, briefs, and memos

Design prompts that simulate real-world legal scenarios, including:

• Contract review and risk identification
• Litigation and Court proceedings.
• Clause interpretation and drafting
• Legal research and case summarization
• Compliance analysis
• Regulatory impact assessments
• Test and validate prompts across leading LLMs such as:
• Legal accuracy and correctness
• Logical reasoning and argument strength
• Alignment with applicable laws and jurisdictions

Risk identification and compliance considerations

• Develop “Golden Responses” (ideal outputs) that serve as benchmarks for model evaluation and training.

Required Skills & Qualifications

• 4–10 years of experience in Legal / Paralegal / Compliance roles
• Strong analytical and critical thinking skills to evaluate AI-generated legal outputs

Preferred Qualifications

• Experience in:

Corporate law, data privacy, litigation, family or regulatory compliance

Legal content writing or knowledge management systems

Exposure to multi-jurisdictional legal frameworks