Remote AI Coding Conversation QA Specialist

Talantir; France; Remote; EUR 27,000 - 46,000; Full time

Job summary

Talantir is seeking technically sharp experts to review transcripts of user–AI coding conversations. This fully remote, contract-based engagement focuses on evaluating AI reasoning, actions, and test workflows.

Ideal candidates include senior or staff engineers, QA engineers, or technical writers who can compare instructions with implementation and provide concise analyses. Weekly payments offered.

Qualifications

• Senior or Staff Engineers with deep code review experience and execution insight.
• QA Engineers with strong verification and consistency-checking habits.
• Technical Writers or Documentation Specialists skilled at comparing instructions vs. implementation.
• Backend or Full-Stack Developers comfortable with function calls, APIs, and test workflows.
• DevOps or SRE professionals familiar with tool orchestration and system behavior analysis.

Responsibilities

• Review long-form transcripts between users and AI coding assistants.
• Analyze the AI’s logic, execution, and stated actions in detail.
• Score each transcript using a 10-point rubric across multiple criteria.
• Optionally write brief justifications citing examples from the dialogue.
• Detect mismatches between claims and actions (e.g., saying I’ll run tests but not doing so).

Skills

Code review

Execution insight

QA/testing mindset

Documentation skills

Tools

Python

JavaScript

TypeScript

Java

C++

Go

Ruby

Rust

Bash

Git

Testing frameworks

Debugging tools

Job description

Talantir is seeking technically sharp experts to review transcripts of user–AI coding conversations. This fully remote, contract-based engagement focuses on evaluating AI reasoning, actions, and test workflows.

Ideal candidates include senior or staff engineers, QA engineers, or technical writers who can compare instructions with implementation and provide concise analyses. Weekly payments offered.