Senior Python Engineer – AI Training & Evaluation (Remote)

Prolific; United States; Remote; USD 55,000 - 83,000; Full time

Job summary

Prolific is seeking Senior Python Developers to join our Expert Network to train and evaluate cutting-edge AI models. If you have a background in Software Engineering, you’ll complete a brief skills test and, if successful, join Prolific as a participant tester, earning pay for tasks.

You’ll review AI-generated Python code for correctness, assess logic, run tests, and provide feedback to improve model reasoning and performance, with a focus on clean, Pythonic solutions.

Qualifications

• BSc or higher in CS or related field.
• Professional Python Senior engineer experience.
• Proficient with modern Python (PEP 8/PEP 20).

Responsibilities

• Evaluate AI-generated Python code for correctness and best practices.
• Validate step-by-step AI explanations for logical soundness.
• Conduct execution testing of model-generated scripts.
• Annotate model performance to identify inefficiencies or incorrect methods.
• Refine technical logic in backend design discussions.

Skills

Senior Python

Python proficiency

GIL knowledge

Async patterns

Education

BSc in CS

Software Eng background

Tools

Django

FastAPI

pytest

Job description

Prolific is seeking Senior Python Developers to join our Expert Network to train and evaluate cutting-edge AI models. If you have a background in Software Engineering, you’ll complete a brief skills test and, if successful, join Prolific as a participant tester, earning pay for tasks.

You’ll review AI-generated Python code for correctness, assess logic, run tests, and provide feedback to improve model reasoning and performance, with a focus on clean, Pythonic solutions.