Remote AI Evaluation Scenario Architect (Part-Time)

Mindrift; Italia; À distance; EUR 23 674 - 35 511; Temps partiel

Avantages offerts par ce poste

Flexible, remote working hours

Competitive pay up to $30/hour

Gain valuable experience for your portfolio

Résumé du poste

A cutting-edge AI consultancy is seeking an Entry-Level Tester to design evaluation scenarios for LLM-based agents. Responsibilities include creating structured test cases to simulate human workflows, ensuring clarity and effectiveness of scenarios, and analyzing agent behaviors. This flexible part-time freelance role allows you to work around your academic or professional commitments while contributing to innovative AI projects. Ideal candidates hold a degree in a relevant field and possess strong analytical and communication skills.

Qualifications

• Bachelor's and/or Master's Degree in Computer Science, Software Engineering, Data Science, Artificial Intelligence, Computational Linguistics, or related fields.
• Background in QA, software testing, data analysis, or NLP annotation.
• Good understanding of test design principles like reproducibility and edge cases.

Responsabilités

• Design realistic evaluation scenarios for LLM-based agents.
• Create structured test cases that simulate human workflows.
• Analyze agent logs and decision paths.

Connaissances

Analytical mindset

Attention to detail

Strong written communication skills in English

Understanding of test design principles

Basic experience with Python

Basic experience with JavaScript

Formation

Bachelor's and/or Master's Degree in relevant fields

Outils

JSON

YAML

Description du poste

A cutting-edge AI consultancy is seeking an Entry-Level Tester to design evaluation scenarios for LLM-based agents. Responsibilities include creating structured test cases to simulate human workflows, ensuring clarity and effectiveness of scenarios, and analyzing agent behaviors. This flexible part-time freelance role allows you to work around your academic or professional commitments while contributing to innovative AI projects. Ideal candidates hold a degree in a relevant field and possess strong analytical and communication skills.