Remote Software Engineer Annotator for AI Training

Odixcity Consulting; La Réunion; On-site; EUR 52,677 - 79,016; Full time

Job summary

Odixcity Consulting is seeking a Software Engineer Annotator to evaluate, label, and improve software engineering datasets used for AI and LLM training. The role requires applying strong programming knowledge to review AI-generated code and ensure high-quality annotations aligned with engineering best practices.

You will annotate and review data, provide structured feedback, and collaborate with AI trainers and data teams.

Qualifications

• Bachelor's degree in computer science, software engineering, or information technology.
• 3–5 years' experience as a Software Engineer.
• Experience in data annotation, AI training, and coding review.
• Strong programming background in Python, Java, JavaScript, C++, or Go.
• Understanding of SDLC and coding best practices.
• Familiarity with APIs, backend systems, and web technologies.
• Knowledge of AI/ML or LLMs is a plus.
• Ability to compare AI-generated responses and rank them.
• Familiarity with annotation platforms or labeling tools.

Responsibilities

• Annotate and review software engineering datasets for AI training.
• Evaluate AI-generated code for correctness, efficiency, readability, and security.
• Label datasets for code completion, debugging, refactoring, and optimization.
• Provide structured feedback to improve model performance.
• Ensure adherence to annotation guidelines and quality standards.
• Collaborate with AI trainers, reviewers, and data teams.

Skills

Analytical thinking

Attention to detail

Education

Bachelor's degree in CS / Software Engineering / IT

Tools

Python

Java

JavaScript

C++

Go

Job description

Job Title: Software Engineer Annotator (remote)

Location: Remote (world-wide)

Job Summary: We are seeking an experienced Software Engineer Annotator responsible for evaluating, labeling, and improving software engineering datasets used for Artificial Intelligence and Large Language Model (LLM) training. The ideal candidate will apply strong programming knowledge to review AI-generated code, validate outputs, and ensure high-quality technical annotations aligned with engineering best practices.

Job Responsibilities

• Annotate and review software engineering datasets for AI training.
• AI-generated code for correctness, efficiency, readability, and security.
• Label datasets including code completion, debugging, refactoring, and optimization tasks.
• Provide structured feedback to improve model performance.
• Ensure adherence to annotation guidelines and quality standards.
• Collaborate with AI trainers, reviewers, and data teams.
  
  

Job Requirements

• Bachelor’s degree in computer science, software Engineering, or information Technology
• Minimum of 3- 5 years’ experience as a Software Engineer.
• Prior experience in data annotation, AI training, and coding review.
• Strong programming background in Python, Java, JavaScript, or C++, or Go.
• Solid understanding of software engineering principles, data structures, and algorithms.
• Ability to annotate, label, and evaluate code datasets accurately.
• Familiarity with software development lifecycle (SDLC) and coding best practices.
• Understanding of APIs, backend systems, and web technologies.
• Basic knowledge of Artificial intelligence, machine learning, or Large Language Models (LLM) is an advantage.
• Capability to compare multiple AI-generated responses and rank them based on accuracy and usefulness.
• Familiarity with annotation platforms or labeling tools.