Senior Python Developer – AI Training & Evaluation (Remote)

Prolific Academic Ltd; United States; Remote; USD 41,000 - 69,000; Full time

Job summary

Prolific is seeking Senior Python Developers to join our Expert Network to train and evaluate AI models. You will assess AI-generated Python code, test in real environments, and provide feedback to improve accuracy and reliability.

Ideal candidates have a strong Software Engineering background, deep Python knowledge (GIL, decorators, asyncio), and experience with Django, FastAPI, or Flask. Competitive pay, flexible hours, and remote work options are available.

Qualifications

• BSc or higher in Computer Science, Software Engineering, or related field.
• Senior Software Engineer/Developer with real-world Python experience.
• Strong Python coding skills with LeetCode Medium–Hard level problems.

Responsibilities

• Evaluate Code Accuracy: review AI-generated Python code for correctness.
• Validate Logic & Reasoning: audit explanations for complex algorithms.
• Conduct Execution Testing: run model-generated scripts to verify performance.
• Annotate Model Performance: identify inefficient or deprecated methods.
• Refine Technical Logic: give feedback on backend architecture and data pipelines.

Skills

Python programming

Async programming

GIL knowledge

Pythonic standards

Unit testing

Code quality

Education

BSc or higher in Computer Science or Software Engineering

Tools

pytest

unittest

coverage.py

tox

Django

FastAPI

Flask

Job description

Prolific is seeking Senior Python Developers to join our Expert Network to train and evaluate AI models. You will assess AI-generated Python code, test in real environments, and provide feedback to improve accuracy and reliability.

Ideal candidates have a strong Software Engineering background, deep Python knowledge (GIL, decorators, asyncio), and experience with Django, FastAPI, or Flask. Competitive pay, flexible hours, and remote work options are available.