Remote Senior Python AI Trainer & Evaluator

Prolific

United States

Remote

USD 57,000 - 81,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Prolific is seeking Senior Python Developers to join our Expert Network and help train and evaluate AI models. You’ll complete a quick skill test, then contribute by reviewing AI-generated Python code for correctness and best practices. Tasks involve execution testing, performance annotation, and feedback on backend design.

Pay is up to $50/hr, with flexible hours and the option to work from home. This is a UK-based opportunity with a focus on high-quality software engineering and data-driven

Qualifications

  • BSc or higher in Computer Science, Software Engineering, or closely related technical field.
  • Real world experience as a Senior Software Engineer/Developer specializing in Python.
  • Ability to solve LeetCode Medium to Hard level problems in Python independently.
  • Deep knowledge of the GIL, decorators, generators, memory management, and asynchronous patterns (asyncio, async/await).
  • Code quality with modularity, readability, and adherence to modern Pythonic standards (PEP 8, PEP 20).
  • Attention to detail to spot memory leaks, obscure logical flaws, or security vulnerabilities in model-generated code.

Responsibilities

  • Evaluate code accuracy: review AI-generated Python code for correctness and best practices.
  • Validate logic and reasoning in AI explanations for complex algorithms.
  • Conduct execution testing of model-generated scripts in appropriate environments.
  • Annotate model performance: identify inefficiencies, deprecated syntax, or hallucinated library methods.
  • Refine technical logic: provide feedback on backend architecture, data pipelines, or API design discussions.

Skills

Senior Python developer
Python proficiency
Code quality
Attention to detail
Problem solving

Education

BSc or higher in Computer Science or Software Engineering

Tools

Django
FastAPI
Flask
pytest
unittest
coverage.py
tox
REST APIs
GraphQL

Job description

Prolific is seeking Senior Python Developers to join our Expert Network and help train and evaluate AI models. You’ll complete a quick skill test, then contribute by reviewing AI-generated Python code for correctness and best practices. Tasks involve execution testing, performance annotation, and feedback on backend design.

Pay is up to $50/hr, with flexible hours and the option to work from home. This is a UK-based opportunity with a focus on high-quality software engineering and data-driven

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Python Developer - AI Training & Evaluation (Remote)
Senior Python Developer - AI Training & Evaluation (Remote)

Prolific • United States

Remote
USD 57,000 - 81,000
Senior Python Engineer - AI Training & Evaluation (Remote)
Senior Python Engineer - AI Training & Evaluation (Remote)

Prolific Academic Ltd • United States

Remote
USD 41,000 - 69,000
Senior Python AI Developer — Training & Evaluation (Remote)
Senior Python AI Developer — Training & Evaluation (Remote)

Prolific • United States

Remote
USD 41,000 - 69,000
Remote Senior Python AI Training Evaluator
Remote Senior Python AI Training Evaluator

prolificacademicltd • United States

Remote
USD 55,000 - 69,000
Senior Python Engineer - AI Training & Evaluation (Remote)
Senior Python Engineer - AI Training & Evaluation (Remote)

Prolific • United States

Remote
USD 55,000 - 83,000
Senior Python Developer - AI Training & Evaluation (Remote)
Senior Python Developer - AI Training & Evaluation (Remote)

Prolific • United States

Remote
USD 57,000 - 81,000
Senior Python Developer — AI Model Training (Remote)
Senior Python Developer — AI Model Training (Remote)

Prolific • United States

Remote
USD 41,000 - 69,000
Senior Python Engineer – AI Training (Remote)
Senior Python Engineer – AI Training (Remote)

Prolific • United States

Hybrid
USD 55,000 - 83,000
Senior Python Engineer - AI Training (Remote)
Senior Python Engineer - AI Training (Remote)

Prolific Academic Ltd • United States

Remote
USD 57,000 - 81,000
Flexible hours
Work from home
Competitive pay rates
Senior Python Developer for AI Training & Validation
Senior Python Developer for AI Training & Validation

Prolific Academic Ltd • United States

Remote
USD 41,000 - 69,000