An application made for this job — a tailored resume and cover letter that speak straight to the posting.
Get past ATS filters
Benefits offered by this job
Flexible working hours
Competitive pay up to $52/hour
Opportunity to influence AI development
Valuable experience for your portfolio
Job summary
A leading AI consultancy is seeking an entry-level professional to design structured evaluation scenarios for AI agents. This part-time, fully remote freelance role allows you to work flexibly and engage in advanced AI projects that enhance your expertise. Ideal candidates will hold a degree in relevant fields and possess analytical skills, strong communication in English, and an understanding of test design principles.
Qualifications
Bachelor's and/or Master's Degree in relevant fields.
Background in QA, software testing, or data analysis required.
Good understanding of test design principles expected.
Responsibilities
Design structured test scenarios based on real-world tasks.
Define golden path and acceptable agent behavior.
Review agent outputs and adapt tests as needed.
Skills
Analytical mindset
Attention to detail
Strong written communication skills in English
Understanding of test design principles
Basic experience with Python
Basic experience with JavaScript
Education
Bachelor's and/or Master's Degree in Computer Science or related fields
Tools
JSON
YAML
Job description
A leading AI consultancy is seeking an entry-level professional to design structured evaluation scenarios for AI agents. This part-time, fully remote freelance role allows you to work flexibly and engage in advanced AI projects that enhance your expertise. Ideal candidates will hold a degree in relevant fields and possess analytical skills, strong communication in English, and an understanding of test design principles.