Senior Python Engineer — AI Training & Evaluation (Remote)

Prolific Academic Ltd; United States; Remote; USD 57,000 - 81,000; Full time

Job summary

Prolific is seeking Senior Python Developers to join its Expert Network, helping train and evaluate cutting-edge AI models. If you have a background in Software Engineering, you’ll take a quick test, and, if successful, join Prolific as a participant to help AI understand and summarize complex scientific data.

Responsibilities include evaluating code accuracy, validating logic and reasoning, executing tests, annotating model performance, and refining backend architecture discussions.

Qualifications

• BSc or higher in Computer Science, Software Engineering, or closely related technical field.
• Real world experience as a Senior Software Engineer/Developer specializing in Python.
• Ability to solve LeetCode Medium to Hard-level problems in Python independently.
• Expert understanding of the GIL, decorators, generators, memory management, and asyncio patterns.
• High standard for clean, modular, readable Python code (PEP 8, PEP 20).
• Attention to detail to spot logical flaws, memory leaks, or security issues in model-generated code.

Responsibilities

• Evaluate AI-generated Python code for functional correctness and best practices.
• Audit step-by-step explanations for complex algorithmic solutions to ensure logical soundness.
• Execute model-generated scripts in appropriate environments to verify performance.
• Identify inefficiencies, deprecated syntax, or hallucinated library methods in models.

Skills

Senior Python Developer

LeetCode medium–hard

GIL knowledge

Decorators

Generators

Memory management

Asyncio

Education

BSc or higher in Computer Science or Software Engineering

Tools

Django

FastAPI

Flask

pytest

unittest

coverage.py

tox

RESTful APIs

GraphQL

Django REST Framework

Job description

Prolific is seeking Senior Python Developers to join its Expert Network, helping train and evaluate cutting-edge AI models. If you have a background in Software Engineering, you’ll take a quick test, and, if successful, join Prolific as a participant to help AI understand and summarize complex scientific data.

Responsibilities include evaluating code accuracy, validating logic and reasoning, executing tests, annotating model performance, and refining backend architecture discussions.