Senior Code Reviewer for LLM Data Training (R)

G2i Inc.; Remote; ZAR 200 000 - 300 000; Full time

Job summary

A remote AI training organization is seeking a Code Reviewer with deep expertise in R to ensure quality assessments of AI-generated code. Responsibilities include reviewing evaluations, ensuring adherence to guidelines, and providing feedback. Ideal candidates have 5–7+ years in R development or QA. This position offers flexibility and competitive compensation.

Qualifications

• 5–7+ years of experience in R development, QA, or code review.
• Strong knowledge of R syntax, debugging, edge cases, and testing.
• Comfortable using code execution environments and testing tools.

Responsibilities

• Review and audit annotator evaluations of AI-generated R code.
• Assess if the R code follows the prompt instructions, is functionally correct, and secure.
• Validate code snippets using proof-of-work methodology.
• Identify inaccuracies in annotator ratings or explanations.
• Provide constructive feedback to maintain high annotation standards.

Skills

R development experience

Code review

Debugging

Documentation skills

Structured QA workflows

English proficiency

Job description

About the Company

G2i connects subject-matter experts, students, and professionals with flexible, remote AI training opportunities, including annotation, evaluation, fact-checking, and content review. We partner with leading AI teams, and all contributions are paid weekly once approved, ensuring consistent and reliable compensation.

About the Role

We’re hiring a Code Reviewer with deep R expertise to review evaluations completed by data annotators assessing AI-generated R code responses. Your role is to ensure that annotators follow strict quality guidelines related to instruction-following, factual correctness, and code functionality.

Responsibilities

• Review and audit annotator evaluations of AI-generated R code.
• Assess if the R code follows the prompt instructions, is functionally correct, and secure.
• Validate code snippets using proof-of-work methodology.
• Identify inaccuracies in annotator ratings or explanations.
• Provide constructive feedback to maintain high annotation standards.
• Work within Project Atlas guidelines for evaluation integrity and consistency.

Required Qualifications

• 5–7+ years of experience in R development, QA, or code review.
• Strong knowledge of R syntax, debugging, edge cases, and testing.
• Comfortable using code execution environments and testing tools.
• Excellent written communication and documentation skills.
• Experience working with structured QA or annotation workflows.
• English proficiency at B2, C1, C2, or Native level.

Preferred Qualifications

• Experience in AI training, LLM evaluation, or model alignment.
• Familiarity with annotation platforms.
• Exposure to RLHF (Reinforcement Learning from Human Feedback) pipelines.

Join a high-impact team working at the intersection of AI and software development. Your R expertise will directly influence the accuracy, safety, and clarity of AI-generated code. This role offers remote flexibility, milestone-based delivery, and competitive compensation.