Senior Python Engineer — AI Model Training & Evaluation

Prolific; United States; Remote; USD 41,000 - 69,000; Full time

Benefits offered by this job

Work from home

Flexible hours

Competitive pay

Job summary

Prolific is seeking Senior Python Developers to join our Expert Network to help train and evaluate cutting-edge AI models. If you have a background in Software Engineering, we’ll send you a quick 10- to 15-minute test to assess your skills.

If successful, you’ll be invited to join Prolific as a participant, where you’ll get paid to help AI understand and summarize complex scientific data. Researchers looking for your skills tend to pay up to $50/hr, depending on skills and experience level.

Qualifications

• BSc or higher in Computer Science, Software Engineering, or closely related technical field.
• Real world experience as a Senior Software Engineer/ Developer specializing in Python.
• Ability to solve LeetCode Medium to Hard-level problems in Python independently.
• Expert understanding of the GIL, decorators, generators, memory management, and asynchronous patterns (asyncio, async/await).
• High standard for clean code, modularity, readability, and adherence to modern Pythonic standards (PEP 8, PEP 20).
• Ability to spot subtle logical flaws, memory leaks, or security vulnerabilities in model-generated code.

Responsibilities

• Review AI-generated Python code for functional correctness and adherence to best practices.
• Audit step-by-step explanations provided by AI for complex algorithms to ensure logical soundness.
• Execute model-generated scripts in appropriate environments to verify performance and output.
• Identify areas where a model provides inefficient solutions, deprecated syntax, or hallucinated library methods.
• Provide structured feedback on how models reason through backend architecture, data pipelines, or API design discussions.

Skills

Python proficiency

Algorithmic problem solving

GIL understanding

Memory management

Asyncio/async patterns

Code quality (PEP 8/PEP 20)

Education

BSc or higher in Computer Science or Software Engineering

Tools

Django

FastAPI

Flask

pytest

unittest

coverage.py

tox

Job description

Prolific is seeking Senior Python Developers to join our Expert Network to help train and evaluate cutting-edge AI models. If you have a background in Software Engineering, we’ll send you a quick 10- to 15-minute test to assess your skills.

If successful, you’ll be invited to join Prolific as a participant, where you’ll get paid to help AI understand and summarize complex scientific data. Researchers looking for your skills tend to pay up to $50/hr, depending on skills and experience level.