Software Engineer for Code Evaluation for AI Training (Python)

G2i Inc.; Phoenix; Remote; ZAR 300 000 - 400 000; Full time

Job summary

A remote AI training company seeks experts to review AI-generated responses for technical accuracy. Ideal candidates will hold a Computer Science degree and have strong experience in Python, along with excellent analytical skills. Responsibilities include evaluating various programming languages and providing feedback to enhance AI systems. Exceptional English writing proficiency is a must, as is experience with large language models and prior software engineering work.

Qualifications

• Significant experience using large language models (LLMs).
• Proficient with algorithms, data structures, and debugging practices.
• Prior experience with RLHF annotation (preferred).
• Prior Software Engineering work experience is strongly preferred.

Responsibilities

• Review and evaluate AI-generated responses for technical accuracy.
• Provide expert feedback to improve AI systems.
• Work with various programming languages and coding challenges.

Skills

Expert in Python

Expert-level English proficiency

Strong analytical skills

Fact-checking expertise

Experience with large language models

Ability to explain complex programming concepts

Education

BS, MS, or PhD in Computer Science

Job description

About the Company

G2i connects subject‑matter experts, students, and professionals with flexible, remote AI training work such as annotation, evaluation, fact‑checking, and content review. We partner with leading AI teams, and all contributions are paid weekly upon approval, ensuring consistent, reliable compensation.

Project info

This project involves reviewing AI‑generated responses, evaluating technical accuracy and best practices, and providing expert feedback that trains AI systems to write better code. You'll work with various programming languages and coding challenges, ensuring AI outputs are functional, efficient, and follow industry standards.

Compensation

Compensation is competitive and varies based on education level, institution, and prior experience.

Hiring Profile

• BS, MS, or PhD with a significant focus on Computer Science (Required).
• Expert in Python, with a firm grasp of algorithms, data structures, and debugging practices.
• Expert-level English proficiency with excellent writing skills.
• Expert at fact‑checking information using public sources across multiple domains.
• Significant experience using large language models (LLMs).
• Strong analytical and structured thinking skills.
• Ability to explain complex programming concepts clearly and accurately.
• Prior experience with RLHF annotation (preferred).
• Prior Software Engineering work experience (strongly preferred).
• Expertise in additional programming languages (nice to have): C#, Java, SQL, C++, TypeScript, PHP, C, Go, Bash, PowerShell, Rust, R.