AI Code Quality Evaluator — Remote Contractor

Talantir; France; Remote; EUR 41,000 - 83,000; Full time

Benefits offered by this job

Remote work

Job summary

Talantir is seeking an Independent Contractor to rigorously evaluate AI-generated coding and software engineering outputs. You will quantify correctness, explainability, and reasoning, and provide actionable feedback to improve model behavior.

The role requires strong programming expertise, open-source experience, and fluency in English. Remote work is offered with flexible scheduling for full-time or part-time engagement.

Qualifications

• BS/MS/PhD in Computer Science or closely related field.
• Significant software engineering experience.
• Expert in at least one language: Python, Java, C++, JavaScript, Go, or Rust.

Responsibilities

• Evaluate LLM-generated coding responses for accuracy and clarity.
• Conduct fact-checking using trusted sources and references.
• Test code by executing and validating outputs with appropriate tools.
• Annotate model responses with strengths and weaknesses.
• Assess code quality, readability, and algorithmic soundness.
• Ensure responses align with guidelines and system behavior.
• Follow evaluation taxonomies, benchmarks, and guidelines.

Skills

Python

Java

C++

JavaScript

Go

Rust

LeetCode/Code Challenges

Open-source contributions

Education

BS/MS/PhD in Computer Science

Job description

Talantir is seeking an Independent Contractor to rigorously evaluate AI-generated coding and software engineering outputs. You will quantify correctness, explainability, and reasoning, and provide actionable feedback to improve model behavior.

The role requires strong programming expertise, open-source experience, and fluency in English. Remote work is offered with flexible scheduling for full-time or part-time engagement.