Senior Python Engineer - Remote AI Model Evaluation

Prolific

South Africa

Remote

ZAR 962,000 - 1,370,000

Full time

21 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Prolific is seeking Senior Python Developers to join our Expert Network to evaluate and train AI models. You’ll review AI-generated Python code, audit explanations for complex algorithms, and run scripts to verify performance.

A background in Python, Django, FastAPI, or Flask is essential, with strong testing practices and a focus on clean, secure code. Role offers remote work with competitive pay up to $50/hr, depending on skills and experience.

Qualifications

  • BSc or higher in Computer Science, Software Engineering, or closely related technical field.
  • Senior Software Engineer/Developer specializing in Python.
  • Ability to solve LeetCode Medium to Hard problems in Python.
  • Deep knowledge of the GIL, decorators, generators, memory management, and asyncio patterns.
  • Code quality standards: modularity, readability, and Pythonic best practices (PEP 8, PEP 20).
  • Ability to spot memory leaks, security vulnerabilities in model-generated code.

Responsibilities

  • Evaluate AI-generated Python code for functional correctness and adherence to best practices.
  • Validate logic and reasoning of AI-provided explanations for complex algorithms.
  • Conduct execution testing of model-generated scripts in appropriate environments.
  • Annotate model performance and detect deprecated syntax or hallucinated methods.
  • Refine feedback on backend architecture, data pipelines, or API design discussions.

Skills

Python
Code quality
Async programming
Testing
API design

Education

BSc or higher in Computer Science/Software Engineering

Tools

Django
FastAPI
Flask
pytest
unittest
coverage.py
tox
GraphQL

Job description

Prolific is seeking Senior Python Developers to join our Expert Network to evaluate and train AI models. You’ll review AI-generated Python code, audit explanations for complex algorithms, and run scripts to verify performance.

A background in Python, Django, FastAPI, or Flask is essential, with strong testing practices and a focus on clean, secure code. Role offers remote work with competitive pay up to $50/hr, depending on skills and experience.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Mechanical Engineer for AI Modeling (Python)
Remote Mechanical Engineer for AI Modeling (Python)

Mindrift • Johannesburg

Remote
ZAR 451,820
Earn up to $20/hour
Fully remote work
Flexible hours
+1
Python Developer | Remote
Python Developer | Remote

Crossing Hurdles • South Africa

On-site
ZAR 600,000 - 900,000
Python - Senior Developers - AI Training
Python - Senior Developers - AI Training

Prolific • South Africa

Remote
ZAR 962,000 - 1,370,000
Remote Mechanical Engineer & AI Trainer (Python)
Remote Mechanical Engineer & AI Trainer (Python)

Mindrift • South Africa

Remote
ZAR 470,652
Flexible working hours
Competitive pay based on expertise
Valuable experience in AI projects
Senior Python Engineer — Remote Testing & Docker
Senior Python Engineer — Remote Testing & Docker

Mindrift • Johannesburg

Remote
ZAR 441,892 - 662,838
Fully remote work
Flexible hours
Competitive compensation up to $24/hour
Senior Python Engineer — AI Testing & Docker (Remote)
Senior Python Engineer — AI Testing & Docker (Remote)

Mindrift • South Africa

Remote
ZAR 441,892 - 530,270
Freelance project-based collaboration
Fully remote and flexible participation
Task-based compensation up to $24/hour
+2
Remote Materials Science Specialist for AI Evaluation
Remote Materials Science Specialist for AI Evaluation

Prolific • South Africa

Remote
ZAR 933,000 - 1,399,000
Applied Scientist | Remote
Applied Scientist | Remote

Crossing Hurdles • South Africa

On-site
ZAR 600,000 - 900,000
Senior Python Engineer - AI/ML & MLOps (Remote)
Senior Python Engineer - AI/ML & MLOps (Remote)

Psybergate (Pty) Ltd • Gauteng

Remote
ZAR 900,000 - 1,200,000
Remote Senior AI/ML Software Engineer
Remote Senior AI/ML Software Engineer

Placements24 • Klerksdorp

Hybrid
ZAR 900,000 - 1,400,000
Stock options
Health benefits
Remote work