Senior Python Engineer - AI Training & Evaluation (Remote)

Prolific; United States; Remote; USD 55,000 - 69,000; Full time

Benefits offered by this job

Work from home

Competitive pay

Flexible hours

Job summary

Prolific is seeking Senior Python Developers to join our Expert Network to help train and evaluate AI models. You’ll undergo a short skills test and, if successful, join Prolific as a participant earning pay for tasks you complete from home.

You'll review AI-generated code, validate reasoning, and annotate model performance. Strong Python knowledge, and experience with clean, modern coding practices are required. This role offers flexible hours and remote work.

Qualifications

• BSc or higher in CS/SE or related technical field.
• Senior software engineer/developer experience with Python.
• Ability to solve LeetCode Medium–Hard problems in Python.
• Deep knowledge of Python internals: decorators, generators, memory management, asyncio.
• Commitment to clean, Pythonic code (PEP 8/PEP 20).
• Attention to memory leaks, security, and correctness in code.

Responsibilities

• Evaluate code accuracy of AI-generated Python code.
• Validate AI explanations for logical soundness.
• Conduct execution testing of scripts.
• Annotate model performance for inefficiencies or hallucinations.
• Refine technical reasoning on architecture and APIs.

Skills

Educational Background

Professional Experience

Coding Proficiency

Domain Knowledge

Code Quality

Attention to Detail

Education

BSc in CS/SE

Job description

Prolific is seeking Senior Python Developers to join our Expert Network to help train and evaluate AI models. You’ll undergo a short skills test and, if successful, join Prolific as a participant earning pay for tasks you complete from home.

You'll review AI-generated code, validate reasoning, and annotate model performance. Strong Python knowledge, and experience with clean, modern coding practices are required. This role offers flexible hours and remote work.