Italian AI Response Evaluator (Remote)

Blueprint-Technologies; Santiago; Presencial; CLP 18.368.000 - 21.429.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Medical, dental, and vision coverage

Flexible Spending Account (FSA)

Competitive paid time off

Parental leave

Professional growth and development

Descripción de la vacante

Blueprint Technologies is seeking an AI Response Labeler with deep Italian language expertise and strong English comprehension to evaluate AI-generated responses. You will compare model outputs, assess factuality, relevance, and tone, and apply Italian cultural context to determine which answer best serves the user's needs across English and Italian content.

The role involves handling diverse tasks, including general Q&A, web results, files, images, and multi-turn conversations, with structured

Formación

• Native‑level or professional fluency in Italian.
• Strong English fluency and reading comprehension, including complex prompts and guidelines.
• Analytical and critical-thinking skills beyond language evaluation.

Responsabilidades

• Perform side‑by‑side comparisons of AI-generated responses and determine which is stronger.
• Evaluate responses for factual accuracy, relevance, completeness, clarity, reasoning, and adherence to guidelines.
• Assess content in English, Italian, or a mix, depending on scenario.
• Evaluate broad ranges of content including general questions, web results, files, images, and prompts in both languages.
• Apply detailed Italian linguistic and cultural context to evaluate terminology, tone, and regional conventions.
• Document evaluation decisions with concise, evidence-based rationale.

Conocimientos

Italian language proficiency

English fluency

Analytical thinking

Attention to detail

Descripción del empleo

Blueprint Technologies is seeking an AI Response Labeler with deep Italian language expertise and strong English comprehension to evaluate AI-generated responses. You will compare model outputs, assess factuality, relevance, and tone, and apply Italian cultural context to determine which answer best serves the user's needs across English and Italian content.

The role involves handling diverse tasks, including general Q&A, web results, files, images, and multi-turn conversations, with structured