Remote C++ AI Code Evaluator (Contract)

Talantir; France; Remote; EUR 55,000 - 96,000; Part time

Benefits offered by this job

Remote work

Job summary

Talantir is seeking a remote, independent contractor to evaluate and improve AI systems focused on coding and software engineering. The role involves rigorous assessment of AI-generated code, explanations, and reasoning across multiple languages, with emphasis on accuracy, clarity, and usefulness.

Fluent English required; remote collaboration with international teams. You will annotate responses, perform fact-checking, and ensure outputs align with platform guidelines and evaluation benchmarks.

Qualifications

• Advanced CS degree or equivalent in software engineering
• Real-world software engineering experience
• Open-source contributions with merged PRs
• Strong English communication and technical writing skills

Responsibilities

• Evaluate LLM-generated coding and software engineering responses for accuracy and clarity
• Conduct fact-checking with trusted sources and references
• Execute code to test outputs and validate results
• Annotate model responses highlighting strengths and areas for improvement
• Assess code quality, readability, algorithmic soundness, and explanations
• Ensure responses follow system guidelines and target behavior
• Follow defined evaluation taxonomies and benchmarks

Skills

Python

C++

JavaScript

Education

BS/MS/PhD in CS

Tools

LeetCode

Job description

Talantir is seeking a remote, independent contractor to evaluate and improve AI systems focused on coding and software engineering. The role involves rigorous assessment of AI-generated code, explanations, and reasoning across multiple languages, with emphasis on accuracy, clarity, and usefulness.

Fluent English required; remote collaboration with international teams. You will annotate responses, perform fact-checking, and ensure outputs align with platform guidelines and evaluation benchmarks.