Code Expert Evaluator for AI Training (Python)

G2i Inc.; São Paulo; Teletrabalho; BRL 80.000 - 120.000; Tempo parcial

Resumo da oferta

A leading technology consulting firm in São Paulo is looking for experts to review AI-generated responses and evaluate their technical accuracy. The ideal candidate will have a strong educational background in Computer Science, proficiency in Python, and significant experience with large language models. This role offers competitive compensation based on education and experience, focusing on remote AI training tasks.

Qualificações

• Expert in Python with a mastery of algorithms and debugging practices.
• Required advanced English writing skills.
• Experience in writing technical evaluations and feedback.

Responsabilidades

• Review AI-generated responses for technical accuracy.
• Provide feedback to improve AI coding capabilities.
• Ensure outputs follow industry standards.

Conhecimentos

Expert in Python

Expert-level English proficiency

Analytical and structured thinking

Expert at fact-checking

Significant experience using large language models

Formação académica

BS, MS, or PhD with a significant focus on Computer Science

Ferramentas

Additional programming languages (C#, Java, SQL, C++, TypeScript, PHP, C, Go, Bash, PowerShell, Rust, R)

Programming languages (C#, Java, SQL, C++, TypeScript, PHP, C, Go, Bash, PowerShell, Rust, R)

Descrição da oferta de emprego

About the Company

G2i connects subject‑matter experts, students, and professionals with flexible, remote AI training work such as annotation, evaluation, fact‑checking, and content review. We partner with leading AI teams, and all contributions are paid weekly upon approval, ensuring consistent, reliable compensation.

Project info

This project involves reviewing AI‑generated responses, evaluating technical accuracy and best practices, and providing expert feedback that trains AI systems to write better code. You'll work with various programming languages and coding challenges, ensuring AI outputs are functional, efficient, and follow industry standards.

Compensation

Compensation is competitive and varies based on education level, institution, and prior experience.

Hiring Profile

• BS, MS, or PhD with a significant focus on Computer Science (Required).
• Expert in Python, with a firm grasp of algorithms, data structures, and debugging practices.
• Expert-level English proficiency with excellent writing skills.
• Expert at fact‑checking information using public sources across multiple domains.
• Significant experience using large language models (LLMs).
• Strong analytical and structured thinking skills.
• Ability to explain complex programming concepts clearly and accurately.
• Prior experience with RLHF annotation (preferred).
• Prior Software Engineering work experience (strongly preferred).
• Expertise in additional programming languages (nice to have): C#, Java, SQL, C++, TypeScript, PHP, C, Go, Bash, PowerShell, Rust, R.