AI Evaluation Engineer — Create AI Challenges Part-Time

Mindrift; Portugal; Teletrabalho; EUR 35 818; Tempo parcial

Resumo da oferta

A project-based AI solutions provider in Portugal seeks experienced developers to create and refine challenging coding tests for AI systems. The ideal candidates will have a degree in Computer Science or related fields, strong expertise in Python, and significant experience with Full-Stack development. This part-time opportunity involves working on tasks estimated to take around 20 hours, offering competitive compensation up to $30 per hour based on contribution levels. English proficiency at a B2 level is required.

Qualificações

• 5+ years in software development, primarily Python (pytest, async/await, subprocess, file operations).
• Background in Full-Stack development with focus on React and robust Back-end systems.
• Experience writing functional and integration tests, not just running them.

Responsabilidades

• Create challenging coding test cases for AI coding systems.
• Review and refine realistic coding tasks based on production codebases.
• Analyze AI failures and iterate based on feedback.

Conhecimentos

Python

Test automation

Full-Stack development

Docker

CI/CD

English proficiency - B2

Formação académica

Degree in Computer Science, Software Engineering or related fields

Descrição da oferta de emprego

A project-based AI solutions provider in Portugal seeks experienced developers to create and refine challenging coding tests for AI systems. The ideal candidates will have a degree in Computer Science or related fields, strong expertise in Python, and significant experience with Full-Stack development. This part-time opportunity involves working on tasks estimated to take around 20 hours, offering competitive compensation up to $30 per hour based on contribution levels. English proficiency at a B2 level is required.