Remote Freelance Coding AI Evaluation Engineer (Russian)

agency; United States; Remote; USD 11,000 - 90,000; Full time

Job summary

agency is seeking a remote contractor to apply software development expertise and fluency in Russian to evaluate AI-generated technical responses. You will test the model on coding tasks, judge both technical quality and Russian-language expression, and document issues to support better training and evaluation.

You will discuss software engineering tasks in Russian, evaluate code for accuracy, assess Russian wording, and capture reproducible errors with their causes.

Qualifications

• Fluency in Russian with strong software development knowledge.
• Experience with algorithms, data structures, software architecture, or cloud infra.
• Ability to assess asynchronous code, API integration, memory management, or distributed systems debugging.
• Clear technical communication and evidence-based review approach.

Responsibilities

• Discuss software engineering tasks and technical scenarios with the model in Russian.
• Evaluate code and explanations for logical accuracy, correctness, and fluency.
• Assess whether Russian wording is natural for the technical context.
• Capture reproducible examples of errors and describe their causes.
• Suggest improvements to prompts and evaluation methods, with clear reasoning.

Skills

Russian fluency

Software development knowledge

Algorithms & data structures

Frontend & Backend development

Cloud infrastructure

Asynchronous code / API integration

Memory management / secure coding

OO design

Technical communication

Education

Bachelors in CS/Software Engineering

Masters/PhD preferred

Job description

agency is seeking a remote contractor to apply software development expertise and fluency in Russian to evaluate AI-generated technical responses. You will test the model on coding tasks, judge both technical quality and Russian-language expression, and document issues to support better training and evaluation.

You will discuss software engineering tasks in Russian, evaluate code for accuracy, assess Russian wording, and capture reproducible errors with their causes.