Remote AI Coding Evaluator – Software Quality

Turing; United States; Remote; USD 3,300 - 5,000; Part time

Benefits offered by this job

Fully remote

Cutting-edge AI projects

Job summary

Turing is a fully remote AI company seeking experienced Software Engineers to evaluate AI coding solutions and improve AI-assisted software development. You will review AI agent runs, assess code quality, and provide structured ratings and evidence-backed feedback.

Candidates must have 3+ years of software engineering, strong knowledge of Python/JavaScript/Java/Go/PHP, and proficiency with Shell, Git, and Docker.

Qualifications

• Minimum 3+ years of overall software engineering experience.
• Strong experience with at least one of the listed languages (Python, JavaScript/TypeScript, Java, Go, PHP).
• Proficiency with Shell commands, Git, Docker, and basic software pipelines.
• Comfortable running and testing real-world projects locally.

Responsibilities

• Review AI coding agent runs and guidance documents for real software tasks.
• Rate each run on 10 quality areas and provide an overall score and ranking.
• Write concise rationales with evidence from the runs.
• Ensure compliance with the no-AI-rationales policy during evaluation.

Skills

Python

JavaScript/TypeScript

Java

Go

PHP

Tools

Shell

Git

Docker

CI/CD basics

Job description

Turing is a fully remote AI company seeking experienced Software Engineers to evaluate AI coding solutions and improve AI-assisted software development. You will review AI agent runs, assess code quality, and provide structured ratings and evidence-backed feedback.

Candidates must have 3+ years of software engineering, strong knowledge of Python/JavaScript/Java/Go/PHP, and proficiency with Shell, Git, and Docker.