Senior Code Reviewer for LLM Data Training (R)

G2i Inc.; Edmonton; Remote; CAD 70,000 - 90,000; Full time

Job summary

A leading AI training company is seeking a Code Reviewer with deep R expertise to ensure the quality and accuracy of AI-generated R code. This remote role involves reviewing evaluator assessments and providing constructive feedback to maintain strict quality guidelines. Ideal candidates will have 5-7+ years in R development or quality assurance and excellent communication skills. Join a high-impact team at the intersection of AI and software development.

Benefits

Flexible remote work

Milestone-based delivery

Competitive compensation

Qualifications

• 5–7+ years of experience in R development, QA, or code review.
• Strong knowledge of R syntax, debugging, edge cases, and testing.
• Excellent written communication and documentation skills.
• Experience working with structured QA or annotation workflows.

Responsibilities

• Review and audit annotator evaluations of AI-generated R code.
• Assess if the R code follows the prompt instructions and is functionally correct.
• Validate code snippets using proof-of-work methodology.
• Provide constructive feedback to maintain high annotation standards.

Skills

R expertise

Code review

Debugging

Testing

Effective communication

Quality Assurance workflows

Job description

About the Company

G2i connects subject-matter experts, students, and professionals with flexible, remote AI training opportunities, including annotation, evaluation, fact-checking, and content review. We partner with leading AI teams, and all contributions are paid weekly once approved, ensuring consistent and reliable compensation.

About the Role

We’re hiring a Code Reviewer with deep R expertise to review evaluations completed by data annotators assessing AI-generated R code responses. Your role is to ensure that annotators follow strict quality guidelines related to instruction-following, factual correctness, and code functionality.

Responsibilities

• Review and audit annotator evaluations of AI-generated R code.
• Assess if the R code follows the prompt instructions, is functionally correct, and secure.
• Validate code snippets using proof-of-work methodology.
• Identify inaccuracies in annotator ratings or explanations.
• Provide constructive feedback to maintain high annotation standards.
• Work within Project Atlas guidelines for evaluation integrity and consistency.

Required Qualifications

• 5–7+ years of experience in R development, QA, or code review.
• Strong knowledge of R syntax, debugging, edge cases, and testing.
• Comfortable using code execution environments and testing tools.
• Excellent written communication and documentation skills.
• Experience working with structured QA or annotation workflows.
• English proficiency at B2, C1, C2, or Native level.

Preferred Qualifications

• Experience in AI training, LLM evaluation, or model alignment.
• Familiarity with annotation platforms.
• Exposure to RLHF (Reinforcement Learning from Human Feedback) pipelines.

Join a high-impact team working at the intersection of AI and software development. Your R expertise will directly influence the accuracy, safety, and clarity of AI-generated code. This role offers remote flexibility, milestone-based delivery, and competitive compensation.