Remote Python Model Evaluator for AI Coding

Benture; Pakistan; Remote; PKR 7,624,000 - 11,436,000; Part time

Job summary

Turing is hiring an experienced Python-focused software engineer for an AI training and evaluation initiative. You will review AI-generated coding solutions, analyze complete agent runs, and provide structured ratings and evidence-based feedback.

Responsibilities include ranking three agent runs, writing rationales, and ensuring rigorous evaluation across performance and safety criteria. Fully remote work with flexible collaboration for this AI project.

Qualifications

• Minimum 3+ years of software engineering experience.
• Strong experience with Python.
• Proficiency with shell commands, Git, Docker, and basic software pipeline setup.
• Comfortable running, modifying, and testing real-world projects locally.

Responsibilities

• Review three AI coding agents given the same developer task and compare results.
• Judge runs using 10 quality areas and assign an overall score.
• Provide a short rationale with evidence-based feedback.
• Rank the three runs and document the rationale.

Skills

Python

Shell commands

Git

Docker

Software pipeline setup

Tools

Git

Docker

Job description

Turing is hiring an experienced Python-focused software engineer for an AI training and evaluation initiative. You will review AI-generated coding solutions, analyze complete agent runs, and provide structured ratings and evidence-based feedback.

Responsibilities include ranking three agent runs, writing rationales, and ensuring rigorous evaluation across performance and safety criteria. Fully remote work with flexible collaboration for this AI project.