Remote Senior Python Developer for AI Training & Evaluation

Prolific; United States; Remote; USD 41,000 - 69,000; Full time

Job summary

Prolific seeks Senior Python Developers to join our Expert Network to help train and evaluate AI models. You’ll complete a quick test after applying; successful candidates may join Prolific as paid participants to help AI understand and summarize data.

We offer the chance to review AI-generated Python code, validate logic, execute tests, and provide feedback on model performance, all from a home-based setup. Competitive pay up to $50/hr, depending on skills and experience.

Qualifications

• Bachelor's degree in Computer Science, Software Engineering, or closely related technical field.
• Real world experience as a Senior Software Engineer/Developer specializing in Python.
• Ability to solve LeetCode Medium to Hard-level problems in Python independently.
• Deep understanding of the GIL, decorators, generators, memory management, and asyncio.
• Code quality standards (PEP 8, PEP 20).
• Attention to detail to spot memory leaks or security issues in model-generated code.

Responsibilities

• Evaluate Code Accuracy: review AI-generated Python code for functional correctness and adherence to best practices.
• Validate Logic & Reasoning: audit step-by-step explanations for complex algorithmic solutions.
• Conduct Execution Testing: run model-generated scripts in appropriate environments.
• Annotate Model Performance: identify inefficient solutions or deprecated syntax.
• Refine Technical Logic: provide feedback on backend architecture, data pipelines, or API design discussions.

Skills

Education

Senior Python

Coding in Python

GIL & Async

Code Quality

Attention to Detail

Education

BSc or higher in Computer Science / Software Engineering

Tools

Django

FastAPI

Flask

pytest

unittest

Job description

Prolific seeks Senior Python Developers to join our Expert Network to help train and evaluate AI models. You’ll complete a quick test after applying; successful candidates may join Prolific as paid participants to help AI understand and summarize data.

We offer the chance to review AI-generated Python code, validate logic, execute tests, and provide feedback on model performance, all from a home-based setup. Competitive pay up to $50/hr, depending on skills and experience.