Remote AI Agent Testing Scenarios Designer

Mindrift

France

Remote

EUR 44,851

Part time

14 days+
Application generator

An application made for this job — a tailored resume and cover letter that speak straight to the posting.

Get past ATS filters

Benefits offered by this job

Flexible working hours
Competitive pay up to $52/hour
Opportunity to influence AI development
Valuable experience for your portfolio

Job summary

A leading AI consultancy is seeking an entry-level professional to design structured evaluation scenarios for AI agents. This part-time, fully remote freelance role allows you to work flexibly and engage in advanced AI projects that enhance your expertise. Ideal candidates will hold a degree in relevant fields and possess analytical skills, strong communication in English, and an understanding of test design principles.

Qualifications

  • Bachelor's and/or Master's Degree in relevant fields.
  • Background in QA, software testing, or data analysis required.
  • Good understanding of test design principles expected.

Responsibilities

  • Design structured test scenarios based on real-world tasks.
  • Define golden path and acceptable agent behavior.
  • Review agent outputs and adapt tests as needed.

Skills

Analytical mindset
Attention to detail
Strong written communication skills in English
Understanding of test design principles
Basic experience with Python
Basic experience with JavaScript

Education

Bachelor's and/or Master's Degree in Computer Science or related fields

Tools

JSON
YAML

Job description

A leading AI consultancy is seeking an entry-level professional to design structured evaluation scenarios for AI agents. This part-time, fully remote freelance role allows you to work flexibly and engage in advanced AI projects that enhance your expertise. Ideal candidates will hold a degree in relevant fields and possess analytical skills, strong communication in English, and an understanding of test design principles.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Evaluation Scenario Writer - AI Agent Testing Specialist
Evaluation Scenario Writer - AI Agent Testing Specialist

Mindrift • France

On-site
EUR 44,851
Flexible working hours
Competitive pay up to $52/hour
Opportunity to influence AI development
+1
AI Agent Evaluation Analyst (Freelance)
AI Agent Evaluation Analyst (Freelance)

Mindrift • France

On-site
EUR 29,671 - 59,343
Flexible work schedule
Competitive pay up to $50/hour
Valuable experience in AI projects
Remote Agent Evaluation Engineer — AI Testing & Tasks
Remote Agent Evaluation Engineer — AI Testing & Tasks

Mindrift • France

Remote
EUR 49,000 - 61,000
Remote QA Evaluation Scenario Writer - Part-time
Remote QA Evaluation Scenario Writer - Part-time

Mindrift • France

Remote
EUR 45,561 - 64,890
Flexible schedule
Competitive pay up to $47/hour
Gain valuable experience in AI
Remote AI Backend Engineer & Task Architect
Remote AI Backend Engineer & Task Architect

Anyone AI Inc. • France

Hybrid
EUR 83,000 - 165,000
Remote Golang Developer for AI Training & Prompting
Remote Golang Developer for AI Training & Prompting

Mindrift • Paris

Remote
EUR 55,000 - 96,000
Flexible schedule
Work on advanced AI projects
Enhance professional portfolio
Remote AI Product Designer — Junior (France)
Remote AI Product Designer — Junior (France)

EverAI • France

Remote
EUR 133,200 - 188,000
4 weeks paid time off
Health & wellness support
Learning budget
+1
Remote Accounting Expert for AI Training Projects
Remote Accounting Expert for AI Training Projects

Mindrift • Paris

Remote
EUR 43,884 - 62,502
Competitive pay rates
Flexible working hours
Experience with advanced AI projects
Remote AI Systems Engineer (Special Projects)
Remote AI Systems Engineer (Special Projects)

Crossing Hurdles • France

Remote
EUR 120,493 - 240,986
Remote Mechanical Engineer & AI Trainer
Remote Mechanical Engineer & AI Trainer

Mindrift • France

Remote
EUR 59,119
Competitive hourly rates up to $50
Flexible freelance schedule
Experience on advanced AI projects