Remote AI Evaluation Scenario Architect (Part-Time)

Mindrift; Italia; Remoto; EUR 23.674 - 35.511; Part-time

Vantaggi offerti da questo lavoro

Flexible, remote working hours

Competitive pay up to $30/hour

Gain valuable experience for your portfolio

Descrizione del lavoro

A cutting-edge AI consultancy is seeking an Entry-Level Tester to design evaluation scenarios for LLM-based agents. Responsibilities include creating structured test cases to simulate human workflows, ensuring clarity and effectiveness of scenarios, and analyzing agent behaviors. This flexible part-time freelance role allows you to work around your academic or professional commitments while contributing to innovative AI projects. Ideal candidates hold a degree in a relevant field and possess strong analytical and communication skills.

Competenze

• Bachelor's and/or Master's Degree in Computer Science, Software Engineering, Data Science, Artificial Intelligence, Computational Linguistics, or related fields.
• Background in QA, software testing, data analysis, or NLP annotation.
• Good understanding of test design principles like reproducibility and edge cases.

Mansioni

• Design realistic evaluation scenarios for LLM-based agents.
• Create structured test cases that simulate human workflows.
• Analyze agent logs and decision paths.

Conoscenze

Analytical mindset

Attention to detail

Strong written communication skills in English

Understanding of test design principles

Basic experience with Python

Basic experience with JavaScript

Formazione

Bachelor's and/or Master's Degree in relevant fields

Strumenti

JSON

YAML

Descrizione del lavoro

A cutting-edge AI consultancy is seeking an Entry-Level Tester to design evaluation scenarios for LLM-based agents. Responsibilities include creating structured test cases to simulate human workflows, ensuring clarity and effectiveness of scenarios, and analyzing agent behaviors. This flexible part-time freelance role allows you to work around your academic or professional commitments while contributing to innovative AI projects. Ideal candidates hold a degree in a relevant field and possess strong analytical and communication skills.