Senior Python Engineer - AI Training & Evaluation (Remote)

Prolific; United States; Remote; USD 41,000 - 69,000; Full time

Job summary

Prolific is seeking Senior Python Developers to join our Expert Network to help train and evaluate cutting-edge AI models. If you have a background in Software Engineering, you’ll complete a brief skill test and, if successful, join Prolific as a participant, paid to help AI understand and summarize complex scientific data.

Researchers paying for this work can go up to $50/hr, with tasks typically requiring about one hour of uninterrupted work.

Qualifications

• BSc or higher in Computer Science, Software Engineering, or closely related technical field.
• Real world experience as a Senior Software Engineer/Developer specializing in Python.
• Ability to solve LeetCode Medium to Hard-level problems in Python independently.
• Expert understanding of the GIL, decorators, generators, memory management, and asynchronous patterns (asyncio).
• Strong adherence to clean code standards (PEP 8, PEP 20).

Responsibilities

• Evaluate AI-generated Python code for functional correctness and best practices.
• Validate logic and reasoning of AI explanations for complex algorithms.
• Conduct execution testing of model-generated scripts in appropriate environments.
• Annotate model performance by identifying inefficient solutions or hallucinated methods.
• Refine technical logic through feedback on backend architecture, data pipelines, or API design discussions.

Skills

Senior Software Engineer

Python

LeetCode Medium-Hard

GIL Understanding

Asyncio

PEP 8

Education

BSc or higher in Computer Science/Software Engineering

Tools

Django

FastAPI

Flask

pytest

Job description

Prolific is seeking Senior Python Developers to join our Expert Network to help train and evaluate cutting-edge AI models. If you have a background in Software Engineering, you’ll complete a brief skill test and, if successful, join Prolific as a participant, paid to help AI understand and summarize complex scientific data.

Researchers paying for this work can go up to $50/hr, with tasks typically requiring about one hour of uninterrupted work.