AI Coding Agent Evaluator - Design & QA Real-World Tasks

Mindrift

Madrid

A distancia

EUR 23.819 - 47.639

A tiempo parcial

14 días+

Consigue una respuesta de este empleador

Tu currículum y tu carta de presentación, adaptados exactamente a lo que buscan contratar.

Supera los filtros ATS

Descripción de la vacante

Mindrift is seeking experienced software developers to work on a project evaluating AI coding agents. This opportunity involves building realistic developer environments and designing tasks that test AI models.

Ideal candidates will have 5+ years of experience, knowledge in Python and JavaScript, and a strong ability to create and write tests. You will work on a project basis and get compensated up to $40/hr depending on your expertise and pace.

Formación

  • 5+ years in software development.
  • Experience in core technologies like Python, JavaScript, Docker.
  • Ability to write functional and integration tests.

Responsabilidades

  • Build realistic developer environments with a codebase and infrastructure.
  • Design tasks that challenge AI coding models effectively.
  • Write tests to verify AI agent solutions, managing acceptance criteria.

Conocimientos

Software Development
Python (FastAPI)
JavaScript/TypeScript (React)
Docker
Postgres
Kafka
Redis
Test Writing (Functional, Integration)
English (B2+)

Descripción del empleo

Mindrift is seeking experienced software developers to work on a project evaluating AI coding agents. This opportunity involves building realistic developer environments and designing tasks that test AI models.

Ideal candidates will have 5+ years of experience, knowledge in Python and JavaScript, and a strong ability to create and write tests. You will work on a project basis and get compensated up to $40/hr depending on your expertise and pace.

Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

AI Evaluation Engineer (Project-Based)
AI Evaluation Engineer (Project-Based)

Mindrift • Barcelona

A distancia
EUR 23.682 - 35.523
Evaluation Scenario Writer - AI Agent Testing Specialist
Evaluation Scenario Writer - AI Agent Testing Specialist

Mindrift • Madrid

A distancia
EUR 20.514 - 29.218
Senior Software Engineer in Test (Full-Stack/Python)
Senior Software Engineer in Test (Full-Stack/Python)

Mindrift • Barcelona

A distancia
EUR 36.147
Remote AI Software Engineer Task Designer
Remote AI Software Engineer Task Designer

Anyone AI • Madrid

A distancia
EUR 29.820 - 89.462
AI Software Engineer Task Designer — Remote, Part-Time
AI Software Engineer Task Designer — Remote, Part-Time

Anyone AI Inc. • España

A distancia
EUR 83.000 - 165.000
Remote Backend Engineer (Contract) — Task Design & QA
Remote Backend Engineer (Contract) — Task Design & QA

Anyone AI Inc. • España

A distancia
EUR 55.000 - 110.000
Senior Python Engineer - AI Testing Project (Freelance, Mindrift)
Senior Python Engineer - AI Testing Project (Freelance, Mindrift)

Mindrift • Barcelona

A distancia
EUR 34.908
Freelance project-based collaboration
Fully remote and flexible participation
Task-based compensation up to $30/hour
+2
Part-Time AI Evaluation & Scenario Writer
Part-Time AI Evaluation & Scenario Writer

Mindrift • Madrid

A distancia
EUR 20.514 - 29.218
AI Coding Evaluator
AI Coding Evaluator

Anyone AI • Madrid

A distancia
EUR 21.000 - 39.000
Software Engineering AI Trainer (Spain)
Software Engineering AI Trainer (Spain)

Anyone AI Inc. • España

A distancia
EUR 83.000 - 165.000