Senior Python Developer - AI Model Evaluation

Prolific

United States

Remote

USD 41,000 - 69,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Prolific in the USA is seeking Senior Python Developers to join our Expert Network to help train and evaluate AI models. You’ll complete a quick 10- to 15-minute test; if successful, you’ll join Prolific as a paid participant to help AI understand and summarize complex data from researchers.

Typical tasks include evaluating AI-generated Python code, validating logic, executing tests, and annotating model performance. Strong Python skills and knowledge of the GIL and asyncio are highly valued.

Qualifications

  • BSc or higher in Computer Science, Software Engineering, or related field.
  • Senior Software Engineer/Developer specializing in Python.
  • Ability to solve LeetCode Medium to Hard-level problems in Python.
  • Expert understanding of the GIL, decorators, generators, memory management, and asyncio.

Responsibilities

  • Evaluate Code Accuracy: review AI-generated Python code for correctness and best practices.
  • Validate Logic & Reasoning: audit AI explanations for complex algorithms.
  • Conduct Execution Testing: run model scripts to verify performance.
  • Annotate Model Performance: identify inefficiencies, deprecated syntax, or hallucinations.
  • Refine Technical Logic: give feedback on backend architecture and data pipelines.

Skills

Python
GIL concepts
Asyncio patterns
Memory management
Code quality

Education

BSc or higher in Computer Science or related field

Tools

Django
FastAPI
Flask
pytest
unittest
tox
coverage.py

Job description

Prolific in the USA is seeking Senior Python Developers to join our Expert Network to help train and evaluate AI models. You’ll complete a quick 10- to 15-minute test; if successful, you’ll join Prolific as a paid participant to help AI understand and summarize complex data from researchers.

Typical tasks include evaluating AI-generated Python code, validating logic, executing tests, and annotating model performance. Strong Python skills and knowledge of the GIL and asyncio are highly valued.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Python Developer - AI Training & Evaluation (Remote)
Senior Python Developer - AI Training & Evaluation (Remote)

Prolific • United States

Remote
USD 57,000 - 81,000
Senior Python Engineer - AI Training & Evaluation (Remote)
Senior Python Engineer - AI Training & Evaluation (Remote)

Prolific • United States

Remote
USD 55,000 - 83,000
Senior Python Developer for AI Training & Validation
Senior Python Developer for AI Training & Validation

Prolific Academic Ltd • United States

Remote
USD 41,000 - 69,000
Senior Python Engineer - AI Training (Remote)
Senior Python Engineer - AI Training (Remote)

Prolific Academic Ltd • United States

Remote
USD 57,000 - 81,000
Flexible hours
Work from home
Competitive pay rates
Senior Python Engineer – AI Training (Remote)
Senior Python Engineer – AI Training (Remote)

Prolific • United States

Hybrid
USD 55,000 - 83,000
Senior Python Engineer - AI Training & Evaluation (Remote)
Senior Python Engineer - AI Training & Evaluation (Remote)

Prolific Academic Ltd • United States

Remote
USD 41,000 - 69,000
Senior Python Developer — AI Model Training (Remote)
Senior Python Developer — AI Model Training (Remote)

Prolific • United States

Remote
USD 41,000 - 69,000
Senior Python AI Developer — Training & Evaluation (Remote)
Senior Python AI Developer — Training & Evaluation (Remote)

Prolific • United States

Remote
USD 41,000 - 69,000
Senior Python Developer - AI Training & Evaluation (Remote)
Senior Python Developer - AI Training & Evaluation (Remote)

Prolific • United States

Remote
USD 57,000 - 81,000
Remote Senior Python AI Trainer & Evaluator
Remote Senior Python AI Trainer & Evaluator

Prolific • United States

Remote
USD 57,000 - 81,000