Remote Legal AI Quality Evaluator

Lexroom Srl; Milano; Remote; EUR 28,000 - 41,000; Part time

Job summary

Lexroom Srl is seeking qualified lawyers to join as independent contractors. You will evaluate AI-generated legal answers and define evaluation criteria, working remotely with a monthly in-person alignment meeting. This role leverages deep legal expertise across areas such as civil, corporate, or tax, and requires an active Italian VAT number and bar admission.

Italian language proficiency is essential. Compensation is €20 per hour, invoiced monthly based on hours worked.

Qualifications

• Must be a qualified lawyer admitted to the Italian Bar (Iscrizione all'Albo).
• Active Italian VAT number (Partita IVA).
• Excellent command of Italian (language requirement).
• Solid experience in at least one area of law (e.g., civil, criminal, administrative, banking & insurance, tax, corporate, employment, family, consumer, insolvency).

Responsibilities

• Legal AI benchmarks: evaluate AI-generated legal answers and define criteria for correctness.
• Arena (Comparative Evaluation): compare model outputs and select the best answer based on predefined criteria.

Education

Law degree (LL.B./J.D.)

Job description

Lexroom Srl is seeking qualified lawyers to join as independent contractors. You will evaluate AI-generated legal answers and define evaluation criteria, working remotely with a monthly in-person alignment meeting. This role leverages deep legal expertise across areas such as civil, corporate, or tax, and requires an active Italian VAT number and bar admission.

Italian language proficiency is essential. Compensation is €20 per hour, invoiced monthly based on hours worked.