Senior Python AI Evaluator — Remote, Flexible Hours

prolificacademicltd; United States; Remote; USD 57,000 - 81,000; Full time

Benefits offered by this job

Remote work

Flexible hours

Assignments up to $50/hr

Job summary

prolificacademicltd is seeking a senior Python developer to assess AI-generated code and explanations. After a brief skills assessment, you may take paid assignments reviewing code, validating execution, and providing structured feedback.

Scheduling is flexible, with some tasks requiring an uninterrupted hour. Responsibilities include evaluating code for correctness and performance, reviewing algorithm explanations, executing scripts, and identifying security concerns or memory issues.

Qualifications

• Bachelor’s-level education in computer science, software engineering, or related field.
• Senior professional experience building software with Python.
• Ability to solve medium- to hard-level algorithm questions in Python without assistance.
• Thorough knowledge of Python internals and patterns (GIL, decorators, generators, memory management, async/await).
• High standards for clean, modular, readable code and modern Python style.
• Careful judgment to catch subtle errors and vulnerabilities in generated code.

Responsibilities

• Evaluate generated Python code for behavior, correctness, and adherence to sound coding practices.
• Review algorithm explanations step by step and identify faulty reasoning.
• Execute scripts to verify their output and performance.
• Detect inefficient implementations, outdated syntax, fabricated library APIs, security concerns, and memory issues.
• Provide technical feedback on model responses about backend architecture, data pipelines, and API design.

Skills

Senior Python development

Python internals

Algorithm questions

Education

Bachelor’s degree or higher in CS/SE

Tools

Django

FastAPI

Flask

Job description

prolificacademicltd is seeking a senior Python developer to assess AI-generated code and explanations. After a brief skills assessment, you may take paid assignments reviewing code, validating execution, and providing structured feedback.

Scheduling is flexible, with some tasks requiring an uninterrupted hour. Responsibilities include evaluating code for correctness and performance, reviewing algorithm explanations, executing scripts, and identifying security concerns or memory issues.