Code Expert Evaluator for AI Training (Python)

G2i Inc.; Goiânia; Teletrabalho; BRL 80.000 - 120.000; Tempo integral

Resumo da oferta

A leading AI training company based in Goiás is seeking a qualified candidate to review and evaluate AI-generated responses. This role requires expertise in programming, especially Python, and the ability to provide constructive feedback to enhance AI systems. The ideal candidate will hold an advanced degree in Computer Science and possess excellent analytical skills. Compensation is competitive and based on education and experience.

Qualificações

• Significant focus on Computer Science is required.
• Expert at fact-checking information using public sources.
• Prior experience with RLHF annotation is preferred.

Responsabilidades

• Review AI-generated responses and evaluate technical accuracy.
• Provide expert feedback that trains AI systems to improve output.

Conhecimentos

Expert in Python

Expert-level English proficiency

Strong analytical and structured thinking skills

Experience using large language models

Ability to explain complex programming concepts

Formação académica

BS, MS, or PhD in Computer Science

Ferramentas

Knowledge of C#, Java, SQL, C++, TypeScript, PHP, C, Go, Bash, PowerShell, Rust, R

Descrição da oferta de emprego

About the Company

G2i connects subject‑matter experts, students, and professionals with flexible, remote AI training work such as annotation, evaluation, fact‑checking, and content review. We partner with leading AI teams, and all contributions are paid weekly upon approval, ensuring consistent, reliable compensation.

Project info

This project involves reviewing AI‑generated responses, evaluating technical accuracy and best practices, and providing expert feedback that trains AI systems to write better code. You'll work with various programming languages and coding challenges, ensuring AI outputs are functional, efficient, and follow industry standards.

Compensation

Compensation is competitive and varies based on education level, institution, and prior experience.

Hiring Profile

• BS, MS, or PhD with a significant focus on Computer Science (Required).
• Expert in Python, with a firm grasp of algorithms, data structures, and debugging practices.
• Expert-level English proficiency with excellent writing skills.
• Expert at fact‑checking information using public sources across multiple domains.
• Significant experience using large language models (LLMs).
• Strong analytical and structured thinking skills.
• Ability to explain complex programming concepts clearly and accurately.
• Prior experience with RLHF annotation (preferred).
• Prior Software Engineering work experience (strongly preferred).
• Expertise in additional programming languages (nice to have): C#, Java, SQL, C++, TypeScript, PHP, C, Go, Bash, PowerShell, Rust, R.