Python - Senior Developers - AI Training

Prolific; United States; Remote; USD 41,000 - 69,000; Full time

Benefits offered by this job

Work from home

Flexible hours

Competitive pay

Job summary

Prolific in the USA is seeking Senior Python Developers to join our Expert Network to train and evaluate AI models. You will review AI-generated Python code, assess logic, and run tests to ensure accuracy. This is a remote role with flexible hours and competitive pay.

Ideal candidates have a strong background in Python, experience with Django/FastAPI/Flask, and a deep understanding of modern Python tooling. You’ll work from home while delivering high quality code insights for advanced AI tasks.

Qualifications

• Bachelor's degree or higher in CS, Software Engineering or related field.
• Senior Software Engineer/Developer with Python experience.
• Strong Python coding ability and problem solving (LeetCode Medium to Hard).
• Deep knowledge of GIL, decorators, generators, memory management, and asyncio.
• High standard for clean, modular Python code (PEP 8/PEP 20).
• Ability to spot memory leaks and security issues in code.

Responsibilities

• Evaluate Code Accuracy: review AI-generated Python code for correctness and best practices.
• Validate Logic & Reasoning: audit step-by-step explanations for complex algorithms.
• Conduct Execution Testing: run scripts to verify performance and outputs.
• Annotate Model Performance: identify inefficient or deprecated methods.
• Refine Technical Logic: provide feedback on backend architecture and API design.

Skills

Python

LeetCode

Asyncio

GIL knowledge

PEP 8

Education

BSc or higher in Computer Science, Software Engineering, or related technical field

Tools

Django

FastAPI

Flask

pytest

unittest

coverage.py

tox

Job description

Python - Senior Developers - AI Training - USA

About Prolific

Prolific is not just another player in the AI space – we are building the biggest pool of quality human data in the world.

Over 35,000 AI developers, researchers, and organizations use Prolific to gather data from paid study participants with a wide variety of experiences, knowledge, and skills.

The role

We’re looking for Senior Python Developers to join our Expert Network to help train and evaluate cutting-edge AI models. If you have a background in Software Engineering, we’ll send you a quick 10- to 15-minute test to assess your skills. If successful, you’ll be invited to join Prolific as a participant, where you’ll get paid to help AI understand and summarize complex scientific data.

Researchers looking for your skills tend to pay up to $50/hr, depending on skills and experience level. You must be prepared to complete paid tasks that require one hour of uninterrupted work, though many are shorter.

What you’ll bring

• Educational Background: a BSc or higher in Computer Science, Software Engineering, or closely related technical field
• Professional Experience: real world experience as a Senior Software Engineer/ Developer specializing in Python
• Coding Proficiency: ability to solve LeetCode Medium to Hard-level problems in Python independently.
• Deep Domain Knowledge: expert understanding of the GIL (Global Interpreter Lock), decorators, generators, memory management, and asynchronous patterns (asyncio, async/await).
• Code Quality: a high standard for clean code, including modularity, readability, and adherence to modern Pythonic standards (PEP 8, PEP 20).
• Attention to Detail: ability to spot subtle logical flaws, memory leaks, or security vulnerabilities in model-generated code.

What you’ll be doing in the role

• Evaluate Code Accuracy: review AI-generated Python code for functional correctness and adherence to best practices.
• Validate Logic & Reasoning: audit the step-by-step explanations provided by AI for complex algorithmic solutions to ensure they are logically sound.
• Conduct Execution Testing: execute model-generated scripts in appropriate environments to verify performance and output.
• Annotate Model Performance: identify areas where a model provides inefficient solutions, deprecated syntax, or hallucinated library methods.
• Refine Technical Logic: provide structured feedback on how models reason through backend architecture, data pipelines, or API design discussions.

Key Technologies

• Core Language: expert mastery of Python 3.x, including type hints and modern language features.
• Frameworks: extensive experience with Django, FastAPI, or Flask.
• Testing & Tools: proficiency with pytest, unittest, coverage.py, and tox.
• Backend & API: strong understanding of RESTful APIs, GraphQL, and server-side logic in a Python environment (e.g., with FastAPI or Django REST Framework).

Why Prolific is a great platform to join as a Participant

Joining our platform as a Prolific participant will give you the chance to influence the AI models of the future using professional legal expertise. Once you pass our assessment, you can join Prolific in just 15 minutes, and start enjoying competitive pay rates, flexible hours, and the ability to work from home.

We’ve built a unique platform that connects researchers and companies with a global pool of participants, enabling the collection of high-quality, ethically sourced human behavioural data and feedback. This data is the cornerstone of developing more accurate, nuanced, and aligned AI systems.

We believe that the next leap in AI capabilities won’t come solely from scaling existing models, but from integrating diverse human perspectives and behaviours into AI development. By providing this crucial human data infrastructure, Prolific is positioning itself at the forefront of the next wave of AI innovation – one that reflects the breadth and the best of humanity.

Links to more information on Prolific

Website

Youtube

Privacy Statement

By submitting your application, you agree that Prolific may collect your personal data for recruiting and global organisation planning. Prolific’sCandidate Privacy Notice explains what personal information Prolific may process, where Prolific may process your personal information, its purposes for processing your personal information, and the rights you can exercise over Prolific use of your personal personal information.