Data Annotator - Applied AI Engineer

Jobgether

India

Remote

INR 3,895,000 - 10,387,000

Part time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive hourly compensation (USD 计
Fully remote in India
Flexible part-time engagement (min 2 h

Job summary

Jobgether in India is seeking a Data Annotator – Applied AI Engineer for a flexible, fully remote, part-time role. You will contribute to evaluating AI systems, annotating prompts, and improving model reasoning using modern AI frameworks.

Responsibilities include analyzing AI-powered apps, evaluating LLMs and RAG pipelines, and providing actionable feedback. Strong Python skills and independent work are essential.

Qualifications

  • 2–6 years of professional experience in Applied AI Engineering or related field.
  • Strong hands-on programming with Python.
  • Experience with LLM APIs (OpenAI, Anthropic, Google Gemini, or open-source).
  • Practical knowledge of Retrieval-Augmented Generation (RAG) and vector databases.
  • Familiarity with AI agent frameworks and multi-agent workflows.
  • Experience with LangChain, LlamaIndex, or comparable frameworks.
  • Understanding of prompt engineering, context management, and LLM evaluation methods.
  • Knowledge of model fine-tuning and inference pipelines.
  • Ability to read and evaluate AI application codebases.
  • Experience with Git/GitHub and collaborative workflows.
  • Strong analytical thinking and clear written communication.
  • Ability to work independently and deliver high-quality results.

Responsibilities

  • Analyze existing AI-powered apps and assess technical correctness.
  • Evaluate LLMs and transformer-based architectures and configurations.
  • Assess RAG pipelines including embeddings and vector databases.
  • Review AI agent architectures, tool-calling and multi-agent workflows.
  • Perform specialized data annotation on prompts, AI responses, and technical docs.
  • Evaluate AI outputs for factual accuracy, reasoning and relevance.
  • Review prompt engineering techniques and system instructions.
  • Examine Python-based AI implementations and integrations.
  • Evaluate APIs, deployment and fine-tuning strategies.
  • Assess apps built with LangChain, LlamaIndex and related tech.
  • Provide clear explanations, annotations, and actionable feedback.
  • Maintain high annotation quality per project guidelines.

Skills

Python
LLM concepts
AI evaluation
Analytical thinking
Independent work

Tools

LangChain
LlamaIndex
OpenAI API
Anthropic API
Google Gemini API

Job description

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Data Annotator – Applied AI Engineer based in India.

The Data Annotator – Applied AI Engineer will contribute to the development and improvement of advanced artificial intelligence systems through specialized technical evaluation and data annotation. This role goes beyond traditional annotation work, focusing on large language models (LLMs), generative AI applications, and intelligent agent workflows. You will assess AI-generated content, review technical implementations, and evaluate the accuracy and reliability of AI-powered solutions. Working with modern technologies such as Retrieval-Augmented Generation (RAG), Python, and AI development frameworks, you will help improve model performance and reasoning capabilities. The position offers the opportunity to apply practical AI engineering expertise to real-world model training and evaluation projects. This is a flexible, fully remote, part-time opportunity suited to professionals with hands-on experience in applied AI.

Accountabilities
  • Analyze existing AI-powered applications, review their implementation logic, assess system architectures, and evaluate technical correctness.
  • Evaluate large language models, transformer-based architectures, model configurations, and LLM integration workflows.
  • Assess Retrieval-Augmented Generation (RAG) pipelines, including embedding models, vector databases, retrieval mechanisms, and context-generation processes.
  • Review AI agent architectures, tool-calling mechanisms, multi-agent workflows, orchestration logic, and autonomous task execution.
  • Perform specialized technical data annotation involving prompts, AI-generated responses, code, agent workflows, and technical documentation.
  • Evaluate AI-generated outputs for factual accuracy, logical reasoning, contextual relevance, instruction adherence, and technical quality.
  • Review and assess prompt engineering techniques, system instructions, prompt chains, and AI-generated responses.
  • Examine Python-based AI implementations, identify logical errors, assess integration approaches, and recommend technically sound improvements.
  • Evaluate LLM APIs, model integrations, fine-tuning strategies, inference pipelines, and AI model deployment workflows.
  • Assess AI applications developed using frameworks such as LangChain, LlamaIndex, and other generative AI development technologies.
  • Produce clear technical explanations, structured annotations, justifications, and actionable feedback to support AI model evaluation and improvement.
  • Maintain high standards of annotation accuracy, consistency, and quality while following project-specific guidelines and evaluation criteria.
Requirements
  • 2–6 years of professional experience, with at least 2 years in Applied AI Engineering, AI Engineering, Generative AI, LLM Engineering, or a related technical field.
  • Strong hands-on programming experience with Python.
  • Practical experience building, integrating, or maintaining applications powered by large language models.
  • Strong understanding of LLMs, transformer-based architectures, and generative AI concepts.
  • Experience working with LLM APIs and models, including OpenAI, Anthropic, Google Gemini, or open-source alternatives.
  • Practical knowledge of Retrieval-Augmented Generation (RAG), embeddings, and vector databases.
  • Familiarity with AI agent frameworks, tool calling, multi-agent systems, and workflow orchestration.
  • Experience with LangChain, LlamaIndex, or comparable AI application development frameworks.
  • Understanding of prompt engineering, context management, and LLM evaluation methodologies.
  • Familiarity with model fine-tuning, inference pipelines, and AI application deployment processes.
  • Ability to independently read, understand, analyze, and evaluate existing AI application codebases.
  • Experience using Git/GitHub and collaborative software development workflows.
  • Strong analytical thinking, technical reasoning, and problem-solving abilities.
  • Excellent written communication skills, with the ability to clearly explain technical decisions, findings, and evaluation results.
  • Ability to work independently, maintain consistent availability, and deliver accurate, high-quality results within project deadlines.
  • Suitable professional backgrounds include Applied AI Engineers, Generative AI Engineers, LLM Engineers, and AI Application Developers.
Benefits
  • Competitive hourly compensation: USD 30–80, depending on project-specific terms and experience.
  • Fully remote working arrangement, allowing you to work from anywhere in India.
  • Flexible part-time engagement with a minimum commitment of 2 hours per day.
  • Flexible working hours, subject to project deadlines and delivery requirements.
  • Opportunity to work on advanced AI projects involving LLMs, generative AI, RAG systems, and intelligent agents.
  • Hands-on exposure to modern AI technologies, frameworks, and model evaluation methodologies.
  • Opportunity to apply and expand your technical expertise while contributing to the development of more accurate and reliable AI systems.
  • Project-based work offering flexibility alongside other professional commitments.

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Annotator - Applied AI Engineer Job ID: 427389
Data Annotator - Applied AI Engineer Job ID: 427389

Masai School • India

Remote
INR 1,102,000 - 2,204,000
Data Annotator - Data Scientist
Data Annotator - Data Scientist

Jobgether • India

Remote
INR 3,895,000 - 10,387,000
Fully remote
Flexible part-time (2 hours/day)
Flexible hours
+1
AI Software Engineer
AI Software Engineer

AItoolnavio • India

Remote
INR 2,137,000 - 3,000,000
Fully remote from India
Equity opportunities
Annual compensation reviews
+5
AI Software Engineer
AI Software Engineer

Jobgether • India

Remote
INR 2,137,000 - 3,000,000
Fully remote working (India)
Equity opportunities
Annual compensation reviews
+4
Data, Business & BI Analysts
Data, Business & BI Analysts

Jobgether • India

Remote
INR 1,102,000 - 2,066,000
Fully remote
Flexible hours
Nov 2026 start
+1
AI Engineer
AI Engineer

Dentsu • Pune District

Hybrid
INR 450,000 - 700,000
AI/Software Engineer
AI/Software Engineer

Applied Systems India Private Limited • Bengaluru

Hybrid
INR 1,500,000 - 3,000,000
AI Data Annotation Specialist – India
AI Data Annotation Specialist – India

Annotera • India

On-site
INR 180,000 - 340,000
GenAI / AI-ML Engineer
GenAI / AI-ML Engineer

Two95 International Inc. • Gurugram District

Hybrid
INR 1,800,000 - 3,000,000
Junior AI Engineer
Junior AI Engineer

WonderBotz LLC. • Ahmedabad District

On-site
INR 600,000 - 900,000
Group Medical
Vacation
Holidays