Remote Senior Python AI Training Evaluator

prolificacademicltd; United States; Remote; USD 55,000 - 69,000; Full time

Job summary

prolificacademicltd in the United States is seeking a senior Python developer to support AI training and evaluation through paid assignments. You’ll judge generated code and technical reasoning, run scripts to confirm results, and offer feedback on backend systems and APIs in a flexible, remote role.

entry to the participant network includes a short skills assessment. You will review Python code for correctness and quality, check explanations of algorithms for logical completeness, and identify

Qualifications

• Senior professional experience building software with Python.
• Independent ability to solve medium- and hard-level algorithm challenges in Python.
• Deep knowledge of Python's GIL, decorators, generators, memory handling, and async patterns.
• Strong Python 3 skills, with experience in Django, FastAPI or Flask and testing frameworks.
• Understanding of REST, GraphQL, and server-side Python systems.

Responsibilities

• Review AI-written Python for correctness, quality, and alignment with accepted practices.
• Check explanations of complex algorithmic answers for logical completeness.
• Run scripts and verify their outputs and performance.
• Identify inefficient implementations, obsolete syntax, and invented library functionality.
• Catch subtle defects, including memory problems and security risks.
• Provide structured assessments of model discussions about architecture, pipelines, and APIs.

Skills

Python programming

Software design principles

Asynchronous programming

Code quality & best practices

Problem solving in Python

Education

Bachelor's degree in CS/SE or related field

Tools

Django

FastAPI

Flask

pytest

unittest

REST APIs

GraphQL

Job description

prolificacademicltd in the United States is seeking a senior Python developer to support AI training and evaluation through paid assignments. You’ll judge generated code and technical reasoning, run scripts to confirm results, and offer feedback on backend systems and APIs in a flexible, remote role.

entry to the participant network includes a short skills assessment. You will review Python code for correctness and quality, check explanations of algorithms for logical completeness, and identify