Remote AI Coding Evaluator & DevOps Engineer

HumanitApp; Pakistan; A distancia; PKR 7.862.000 - 11.197.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Work in a fully remote environment

Cutting-edge AI projects with leadingL

Descripción de la vacante

Turing is seeking experienced Software Engineers to support AI training and evaluation initiatives focused on coding capabilities. You will review and compare AI-generated solutions, analyze workflows, evaluate code, and provide structured feedback to improve AI-assisted software development.

Day-to-day involves reviewing runs, rating quality, and ranking three solutions. This contractor role requires at least 8 hours daily, 40 hours weekly, with a 4-hour overlap with PST, and offers remote work

Formación

• Minimum 3+ years of overall experience.
• Proficiency with Shell commands, Git, Docker, and basic software pipeline setup.
• Comfortable running, modifying, and testing real‑world projects locally.

Responsabilidades

• Review three AI coding agents' runs and judge which run did the job best.
• Rate runs on 10 quality areas and assign overall scores.
• Write a short rationale with evidence from the runs.
• Complete three practice evaluation tasks as part of the selection process.
• Ensure no AI-generated rationales; independent reasoning is required.

Conocimientos

Shell commands

Git

CI/CD basics

Herramientas

Docker

Descripción del empleo

Turing is seeking experienced Software Engineers to support AI training and evaluation initiatives focused on coding capabilities. You will review and compare AI-generated solutions, analyze workflows, evaluate code, and provide structured feedback to improve AI-assisted software development.

Day-to-day involves reviewing runs, rating quality, and ranking three solutions. This contractor role requires at least 8 hours daily, 40 hours weekly, with a 4-hour overlap with PST, and offers remote work