Data Annotation Specialist – Code Evaluation & Reasoning

Coffeee.io; India; On-site; INR 400,000 - 700,000; Full time

Job summary

Coffeee.io is seeking a Data Annotation Specialist – Code Evaluation & Reasoning to help develop advanced AI models by reviewing code in Python and at least one of TypeScript, Java, or Go. You will annotate, reason, and provide technical feedback following guidelines.

This role focuses on reviewing code, identifying issues, and evaluating solutions rather than software development. Strong English writing and attention to detail are essential.

Qualifications

• Bachelor's degree in CS/IT/Engineering or related field.
• Experience in software development, QA, or AI data annotation.
• Strong written English communication and ability to explain technical concepts.

Responsibilities

• Evaluate code for correctness, logic, efficiency, and best practices.
• Review AI-generated code and provide structured annotations and feedback.
• Compare multiple solutions to determine the best implementation.
• Identify bugs, edge cases, and potential security concerns.
• Explain code behavior and reasoning clearly for stakeholders.
• Annotate tasks per project guidelines with consistency and quality.
• Assess algorithm efficiency and suggest improvements.

Skills

Python

TypeScript

Java

Go

DSA

Code review

OOP

Eng comms

Detail orientation

Education

Bachelor's degree in CS/IT/Engineering

Tools

Git

REST APIs

Job description

We are looking for a Data Annotation Specialist – Code Evaluation & Reasoning to support the development of advanced AI models. In this role, you will analyze, evaluate, and annotate code written in Python and at least one of TypeScript, Java, or Go. Your work will help improve the quality, accuracy, and reasoning capabilities of AI systems.

This is not a software development role. Instead, you'll use your programming knowledge to review code, identify issues, compare solutions, and provide clear technical reasoning following annotation guidelines.

Key Responsibilities

• Evaluate code for correctness, logic, efficiency, and adherence to best practices.
• Review AI-generated code and provide structured annotations and technical feedback.
• Compare multiple code solutions and determine the most appropriate implementation.
• Identify bugs, logical errors, edge cases, and potential security concerns.
• Explain code behavior and reasoning in a clear and concise manner.
• Annotate coding tasks according to project guidelines while maintaining high quality and consistency.
• Assess algorithm efficiency and suggest improvements where applicable.
• Collaborate with project teams to improve annotation quality and AI model performance.
• Maintain accuracy, consistency, and productivity while working on large annotation datasets.

Required Skills

• Strong proficiency in Python.
• Hands-on knowledge of at least one of the following:
• TypeScript
• Java
• Go (Golang)
• Solid understanding of Data Structures and Algorithms.
• Strong code reading, debugging, and code review skills.
• Ability to understand and evaluate unfamiliar code quickly.
• Good knowledge of Object-Oriented Programming concepts.
• Strong analytical, logical reasoning, and problem-solving skills.
• Excellent written English and technical communication skills.
• High attention to detail and ability to follow annotation guidelines consistently.
• Preferred Qualifications
• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
• Experience in software development, technical content review, code review, QA, or AI data annotation.
• Familiarity with Git, REST APIs, and software development best practices.
• Exposure to Large Language Models (LLMs), Generative AI, or AI-assisted coding tools is an advantage.

What We're Looking For

• Strong analytical thinking and technical reasoning.
• Ability to evaluate code objectively and justify decisions with clear explanations.
• Consistent attention to detail and commitment to quality.
• Comfortable working with structured annotation guidelines and quality metrics.
• Interest in contributing to the development of next-generation AI systems.