Senior Python Engineer - AI Training & Evaluation (Remote)

Prolific Academic Ltd

United States

Remote

USD 41,000 - 69,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Prolific is seeking Senior Python Developers to join our Expert Network in the USA to help train and evaluate AI models. You will tackle validation, testing, and feedback on AI-generated Python code, ensuring correctness and modern Python standards.

Successful candidates will work remotely on tasks that support researchers and developers globally. You'll review code, audit reasoning, and refine backend logic, with compensation up to $50 per hour depending on skills and experience.

Qualifications

  • Educational Background: a BSc or higher in Computer Science, Software Engineering, or closely related technical field
  • Professional Experience: real world experience as a Senior Software Engineer/ Developer specializing in Python
  • Coding Proficiency: ability to solve LeetCode Medium to Hard-level problems in Python independently.
  • Deep Domain Knowledge: expert understanding of the GIL (Global Interpreter Lock), decorators, generators, memory management, and asynchronous patterns (asyncio, async/await).
  • Code Quality: a high standard for clean code, including modularity, readability, and adherence to modern Pythonic standards (PEP 8, PEP 20).
  • Attention to Detail: ability to spot subtle logical flaws, memory leaks, or security vulnerabilities in model-generated code.

Responsibilities

  • Evaluate Code Accuracy: review AI-generated Python code for functional correctness and adherence to best practices.
  • Validate Logic & Reasoning: audit the step-by-step explanations provided by AI for complex algorithmic solutions to ensure they are logically sound.
  • Conduct Execution Testing: execute model-generated scripts in appropriate environments to verify performance and output.
  • Annotate Model Performance: identify areas where a model provides inefficient solutions, deprecated syntax, or hallucinated library methods.
  • Refine Technical Logic: provide structured feedback on how models reason through backend architecture, data pipelines, or API design discussions.

Skills

Python
GIL knowledge
Asyncio
Code quality

Education

BSc in CS

Tools

Django
FastAPI
Flask

Job description

Prolific is seeking Senior Python Developers to join our Expert Network in the USA to help train and evaluate AI models. You will tackle validation, testing, and feedback on AI-generated Python code, ensuring correctness and modern Python standards.

Successful candidates will work remotely on tasks that support researchers and developers globally. You'll review code, audit reasoning, and refine backend logic, with compensation up to $50 per hour depending on skills and experience.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Python Engineer - AI Training & Evaluation (Remote)
Senior Python Engineer - AI Training & Evaluation (Remote)

Prolific • United States

Remote
USD 55,000 - 83,000
Senior Python Developer - AI Training & Evaluation (Remote)
Senior Python Developer - AI Training & Evaluation (Remote)

Prolific • United States

Remote
USD 57,000 - 81,000
Senior Python Developer - AI Training & Evaluation (Remote)
Senior Python Developer - AI Training & Evaluation (Remote)

Prolific • United States

Remote
USD 57,000 - 81,000
Senior Python Developer — AI Model Training (Remote)
Senior Python Developer — AI Model Training (Remote)

Prolific • United States

Remote
USD 41,000 - 69,000
Senior Python Engineer – AI Training (Remote)
Senior Python Engineer – AI Training (Remote)

Prolific • United States

Hybrid
USD 55,000 - 83,000
Senior Python AI Developer — Training & Evaluation (Remote)
Senior Python AI Developer — Training & Evaluation (Remote)

Prolific • United States

Remote
USD 41,000 - 69,000
Senior Python Developer for AI Training & Validation
Senior Python Developer for AI Training & Validation

Prolific Academic Ltd • United States

Remote
USD 41,000 - 69,000
Senior Python Engineer for AI Training (Remote)
Senior Python Engineer for AI Training (Remote)

prolificacademicltd • United States

Remote
USD 57,000 - 81,000
Remote work
Hourly pay up to $50
Senior Python Engineer for AI Training & Review (Remote)
Senior Python Engineer for AI Training & Review (Remote)

prolificacademicltd • United States

Remote
USD 41,000 - 69,000
Remote work
Flexible task-based work
Competitive hourly rate
Senior Python Engineer - AI Training (Remote)
Senior Python Engineer - AI Training (Remote)

Prolific Academic Ltd • United States

Remote
USD 57,000 - 81,000
Flexible hours
Work from home
Competitive pay rates