AI Quality Analyst - Flexible Hours

Innodata Inc.; United States; Hybrid; USD 17,000 - 24,000; Part time

Job summary

Innodata Inc. is seeking a Generative AI Specialist to join its global SME on Demand program. This part-time, remote role focuses on rating, labeling, and transforming data to support AI model development and evaluation.

It offers flexible scheduling and global scope for contributors with a passion for language and reasoning. You will work on labeling tasks, content evaluation, and data augmentation, contributing to state-of-the-art AI systems while managing time effectively from anywhere in the

Qualifications

• Bachelor’s degree in humanities required; advanced degree preferred.
• Professional or expert English (C1/C2) proficiency expected.

Responsibilities

• Rate and assess AI model outputs using predefined evaluative questions.
• Label content elements and assign predefined categories or labels.
• Generate training data by transforming data (text paraphrasing, summarization).
• Review data against project guidelines to ensure feature functionality.
• Create prompts or questions for language model responses.
• Produce concise summaries of longer texts or data.

Skills

English proficiency (C1/C2)

Education

Bachelor’s degree in humanities

Master’s or PhD preferred

Job description

Innodata(Nasdaq: INOD) is a global data engineering company. We believe that data and Artificial Intelligence (AI) are inextricably linked.Our mission is to enable the responsible advancement of artificial intelligence by providing the data, evaluation frameworks, and human expertise required to build AI systems that can be trusted at scale.We provide a range of transferable solutions, platforms, and services for Generative AI / AI builders and adopters. In every relationship, we honor our 36+ year legacy delivering the highest quality data and outstanding outcomes for our customers.

Scope of the Role:

At Innodata, we’re partnering with the world’s leading technology companies to build the future of generative AI and large language models (LLMs). We’re on the lookout for smart, savvy, and curious Generative AI Specialist to join our global contributor community as part of our Subject Matter Expert (SME) on Demand program.

This is not a traditional full-time role. It’s a part-time, remote, flexible, project-specific opportunity designed for those who want to make a real impact—on their schedule. Whether you’re a writer, linguist, educator, researcher, or just deeply passionate about language and logic, this role lets you contribute to cutting-edge AI development while maintaining control over your time.

You’ll be helping LLMs learn the intricacies of language and reasoning—not just how to write, but how to think. If you’ve ever dreamed of shaping the intelligence behind tomorrow’s technology, this is your chance.

This is more than just a gig—it’s a rare chance to help shape the future of AI from anywhere in the world, on your own terms.

What You’ll Own:

• Rating/assessing the performance of AI models or algorithms based on their output or behavior through a set of evaluative questions.
• Labeling elements of a piece of content rather than the content as a whole.
• Assigning predefined categories or labels to items.
• Evaluating the perceived quality and/or appropriateness of content
• Generating labels to advance understanding of a concept, trend etc.
• Creation of additional training data for machine learning models by applying transformations to the original data, such as modifying images (rotation, flipping, cropping), generating new text (paraphrasing, summarization), or altering audio/video signals (speed modification, pitch shifting) to reduce overfitting and increase dataset diversity.
• Reviewing data and identifying whether or not a product feature works as intended based on the project’s guidelines.
• Labeling model outputs to identify if a piece of content is or isn’t something. Examples: identify clickbait; identifying gaming videos; identifying branded content.
• Ordering or ranking items based on a set of preferences or criteria.
• Creating prompts or questions that will be used to generate responses from a language model or other AI system.
• Projects that evaluate the relevance of content based on a relevancy scale (1-3, 1-5, etc.).
• Generating responses to prompts or questions using a language model or other AI system.
• Rewriting existing text while preserving the original meaning, often to improve clarity or style and adherence to guidelines.
• Producing concise summaries of longer pieces of text or data.
• Converting spoken language or audio content into written text.
• Converting text or spoken language from one language to another.
• Gathering and compiling various forms of data to be used for training, evaluating, or fine-tuning the AI models. This may include text, images, videos, audio files, or other types of digital content.

You’ll Thrive in This Role If You Have:

• A Bachelor’s degree or higher in a humanities specialization is required. Advanced degrees are strongly preferred (Master’s or PhD)
• Professional or Expert level proficiency (C1/C2) in English

The expected hourly salary range for this position is $15 p/hour, based on experience, skills, and qualifications.