Senior Python Developer - AI Model Evaluator

Prolific; United States; Remote; USD 55,000 - 83,000; Full time

Job summary

Prolific is seeking Senior Python Developers to join Expert Network to help train and evaluate AI models. You’ll review AI-generated Python code for accuracy, validate logic, and run tests in appropriate environments to ensure high-quality outputs.

We value deep Python knowledge, experience with Django, FastAPI, or Flask, and strong testing practices. Enjoy competitive pay and flexible hours while contributing to cutting-edge AI research.

Qualifications

• BSc or higher in Computer Science, Software Engineering, or related field.
• Senior Software Engineer/Developer with Python experience.
• Ability to solve LeetCode Medium to Hard problems in Python.
• Deep understanding of the GIL, decorators, generators, memory management, and async patterns.
• Adherence to clean, modern Python standards (PEP 8, PEP 20).
• Ability to spot memory leaks, security issues in code.

Responsibilities

• Evaluate Code Accuracy: review AI-generated Python code for functional correctness and best practices.
• Validate Logic & Reasoning: audit step-by-step explanations for complex algorithms.
• Conduct Execution Testing: run model-generated scripts to verify performance and outputs.
• Annotate Model Performance: identify inefficient solutions or deprecated syntax.
• Refine Technical Logic: provide feedback on backend architecture and data pipelines.

Skills

LeetCode Python

GIL knowledge

Decorators

Asyncio

Code quality

PEP 8

Memory mgmt

Generators

Python 3.x

REST APIs

Education

BSc in CS/SE

Tools

Django

FastAPI

Flask

pytest

unittest

coverage.py

tox

Job description

Prolific is seeking Senior Python Developers to join Expert Network to help train and evaluate AI models. You’ll review AI-generated Python code for accuracy, validate logic, and run tests in appropriate environments to ensure high-quality outputs.

We value deep Python knowledge, experience with Django, FastAPI, or Flask, and strong testing practices. Enjoy competitive pay and flexible hours while contributing to cutting-edge AI research.