Senior Code Reviewer for LLM Data Training (Python + Docker)

Macgence

India

Remote

INR 827,000 - 1,309,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive hourly rates
Remote-first culture

Job summary

Macgence is seeking an experienced Senior Code Reviewer with deep Python expertise to audit evaluations of AI-generated code responses. You will ensure annotation teams maintain high standards for instruction-following, correctness, and functionality in AI training datasets.

You will work in a remote-first setup, collaborating with cross-functional teams and contributing to the quality of AI training pipelines.

Qualifications

  • 4+ years in Python development, QA, or code review.
  • Expert Python syntax, debugging, and testing.
  • Docker proficiency for environment isolation and testing.
  • Excellent written communication and documentation skills.
  • Experience with structured QA or annotation workflows.

Responsibilities

  • Review and audit annotator evaluations of AI-generated Python code.
  • Validate code functionality, security, and best practices across projects.
  • Provide constructive feedback to maintain annotation quality standards.
  • Execute proof-of-work methodology using Docker-based environments.

Skills

Python development
QA & code review
Docker proficiency
Documentation skills
QA workflows

Tools

Docker

Job description

About the Role

We're seeking an experienced Senior Code Reviewer with deep Python expertise to review evaluations of AI-generated code responses. You'll ensure annotation teams maintain high standards for instruction-following, correctness, and functionality in AI training datasets.

Key Responsibilities
  • Review and audit annotator evaluations of AI-generated Python code
  • Validate code functionality, security, and best practices across multiple programming
Languages
  • Execute proof-of-work methodology using Docker-based environments
  • Provide constructive feedback to maintain annotation quality standards
  • Work within established guidelines for evaluation consistency
Required Qualifications
  • Minimum 4+ years in Python development, QA, or code review
  • Strong Python expertise, including syntax, debugging, and testing
  • Docker proficiency for environment isolation and testing
  • Excellent written communication and documentation skills
  • Experience with structured QA or annotation workflows
Preferred Qualifications
  • Experience in AI training, LLM evaluation, or model alignment
  • Familiarity with RLHF pipelines and annotation platforms
  • Advanced Docker knowledge for complex environment replication
Why Join Us?
  • Work at the intersection of AI and software development
  • Remote-first culture with flexible arrangements
  • Competitive hourly compensation
  • Early-stage pipeline project with long-term potential
Application Process

Two-Stage Assessment:

  1. Technical Task (60 minutes) - Coding assessment with recorded responses
  2. Technical Interview (25 minutes) - Only for candidates who pass the task
Requirements
  • Individual candidate engagement model with managed oversight
  • Early submission with competitive rates preferred
  • Multiple coding languages required (list provided separately)
  • Available for immediate start upon project finalization
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Annotation Specialist – Code Evaluation & Reasoning
Data Annotation Specialist – Code Evaluation & Reasoning

Coffeee.io • India

On-site
INR 400,000 - 700,000
Remote Python Programmer
Remote Python Programmer

Turing • India

Remote
INR 1,200,000 - 2,400,000
Fully remote environment
Work on cutting-edge AI projects
Reviewer and rate AI-generated code-Python
Reviewer and rate AI-generated code-Python

Softechub • India

Remote
INR 827,000 - 1,653,000
Remote Python Developer
Remote Python Developer

Turing • Kolkata District

Remote
INR 2,484,400 - 4,968,800
Remote Python Developer
Remote Python Developer

Turing • India

Remote
INR 508,000 - 608,000
Fully remote environment
Cutting-edge AI project involvement
Code Reviewer - C++
Code Reviewer - C++

ZettaMine Labs Pvt. Ltd. • India

Remote
INR 1,611,000 - 2,295,000
Remote Python Programmer
Remote Python Programmer

Turing • Hyderabad

Remote
INR 5,420,054 - 8,130,081
Remote Python Engineer
Remote Python Engineer

Turing • Hyderabad

Remote
INR 827,000 - 1,653,000
Remote Python Engineer
Remote Python Engineer

Turing • Hyderabad

Remote
INR 3,726,600 - 6,211,001
AI Evaluator - Python (Freelance Opportunity)
AI Evaluator - Python (Freelance Opportunity)

Biz Tech Consultants • New Delhi

On-site
INR 1,200,000 - 2,400,000