Remote AI Agent Evaluation Specialist

Mindrift

Milano

Remote

EUR 23,623 - 35,435

Part time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Flexible, remote work
Competitive pay up to $30/hour
Gain experience in advanced AI projects

Job summary

An innovative AI project firm in Milan seeks QAs for autonomous AI agents. This flexible, project-based role requires strong analytical thinking, attention to detail, and good communication skills in English. Ideal candidates include analysts or students eager to contribute to AI validation efforts while balancing other commitments. The role involves reviewing logic and completeness of scenarios and helping refine AI behaviors. Compensation can be up to $30/hour based on skills and experience.

Qualifications

  • Excellent analytical thinking about complex systems.
  • Strong attention to detail for spotting contradictions.
  • Good communication skills for documenting findings.

Responsibilities

  • Review evaluation tasks for logic and completeness.
  • Identify inconsistencies and unclear decision points.
  • Help define expected behaviors for AI agents.

Skills

Analytical thinking
Attention to detail
Good communication in English

Education

Background in consulting or academia

Tools

Familiarity with JSON/YAML

Job description

An innovative AI project firm in Milan seeks QAs for autonomous AI agents. This flexible, project-based role requires strong analytical thinking, attention to detail, and good communication skills in English. Ideal candidates include analysts or students eager to contribute to AI validation efforts while balancing other commitments. The role involves reviewing logic and completeness of scenarios and helping refine AI behaviors. Compensation can be up to $30/hour based on skills and experience.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Evaluation Scenario Architect (Part-Time)
Remote AI Evaluation Scenario Architect (Part-Time)

Mindrift • Italy

Remote
EUR 23,674 - 35,511
Flexible, remote working hours
Competitive pay up to $30/hour
Gain valuable experience for your portfolio
Remote AI Safety Tester
Remote AI Safety Tester

TSMG Holding • Roma

Remote
EUR 26,000 - 39,000
AI Agent Evaluation Analyst (Freelance)
AI Agent Evaluation Analyst (Freelance)

Mindrift • Milano

Remote
EUR 23,623 - 35,435
Flexible, remote work
Competitive pay up to $30/hour
Gain experience in advanced AI projects
Remote AI Quality Analyst: Personalization & Evaluation
Remote AI Quality Analyst: Personalization & Evaluation

Turing • Turbigo

Remote
EUR 17,909
Advanced Italian AI Training Specialist — Remote & Flexible
Advanced Italian AI Training Specialist — Remote & Flexible

Prolific • Roma

Remote
EUR 29,044 - 41,366
Competitive pay rates
Flexible hours
Ability to work from home
Remote AI Italian Language QA Editor
Remote AI Italian Language QA Editor

SME Careers • Italy

Remote
EUR 34,000 - 55,000
Remote AI Data Annotator & Evaluator — Italian Localization
Remote AI Data Annotator & Evaluator — Italian Localization

CNTXT AI • Turbigo

Remote
EUR 27,552 - 55,104
Remote AI Search Evaluator (Italy, Part-Time)
Remote AI Search Evaluator (Italy, Part-Time)

RWS • Messina

Remote
EUR 11,000 - 16,000
Flexible home-based work
Work-life balance
Potential side-hustle
+2
AI Agent Engineer — Multi-Channel Integrations
AI Agent Engineer — Multi-Channel Integrations

Wonderful Ltd. • Milano

On-site
EUR 40,000 - 70,000
Remote Full-Stack Engineer — Part-Time Consultant (Italian)
Remote Full-Stack Engineer — Part-Time Consultant (Italian)

Anyone AI Inc. • Italy

Remote
EUR 28,000 - 62,000