Remote AI Language Quality Analyst

YO AI Labs; Austin (TX); Remote; USD 28,000 - 52,000; Full time

Job summary

YO AI Labs is seeking an English Language Expert to support an AI training and evaluation project in a remote, hourly contractor role. You will review AI-generated English responses, craft expert language content, evaluate reasoning quality, and provide precise feedback to improve model accuracy.

The ideal candidate holds a Bachelor's degree in linguistics or related field, excellent English (C1/C2), and a track record in editorial QA, multilingualism, and AI tooling.

Qualifications

• Bachelor’s degree or higher in Linguistics, English, Translation/Localization, Communications, Journalism, or related field.
• Minimum C1 English proficiency; C2 or native-level command strongly preferred.
• Strong knowledge of grammar, syntax, semantics, pragmatics, discourse structure, and stylistic editing.
• Exceptional attention to detail and ability to identify subtle errors, ambiguity, inconsistencies, and meaning drift.
• Excellent written and verbal communication skills.
• Ability to explain corrections, reasoning, and language decisions clearly.
• Strong analytical and critical-thinking skills.
• Ability to apply style guides and maintain consistency across content types and registers.
• Ability to work independently and reliably in a remote environment across time zones.

Responsibilities

• Create high-quality prompts and expert responses across diverse topics to support AI model training.
• Review AI-generated English responses for accuracy, clarity, relevance, and adherence to the given prompt.
• Evaluate the quality of reasoning and step-by-step solutions.
• Identify errors in logic, meaning, methodology, grammar, syntax, or conceptual understanding.
• Fact-check information when necessary and identify unsupported or inaccurate claims.
• Edit and revise AI-generated responses to demonstrate correct, natural, and effective language.
• Provide precise, clear, and actionable written feedback explaining errors and recommended improvements.
• Rate and compare multiple AI responses based on correctness, reasoning quality, fluency, and contextual relevance.
• Evaluate AI outputs for ambiguity, inconsistencies, meaning drift, and potential biases.
• Apply relevant style guides and maintain consistency in tone, terminology, punctuation, capitalization, and formatting.
• Develop AI training content that improves model accuracy, fluency, and contextual understanding.
• Test AI models across different use cases to identify potential quality and reliability issues.
• Use AI tools such as ChatGPT, Gemini, Perplexity, and other relevant platforms during content creation and evaluation.
• Maintain consistent quality and productivity in an hourly, remote contractor environment.

Skills

Expert English – C1/C2

Linguistics

Grammar & Syntax

Semantics & Pragmatics

Discourse Analysis

Stylistic Editing

AI Response Evaluation

Prompt Development

AI Training Data

Reasoning Evaluation

Fact-Checking

Editorial QA

Attention to Detail

Written Communication

Verbal Communication

Critical Thinking

Multilingual Proficiency

AI Tool Proficiency

Education

Bachelor’s degree or higher

Tools

ChatGPT

Gemini

Perplexity

Job description

YO AI Labs is seeking an English Language Expert to support an AI training and evaluation project in a remote, hourly contractor role. You will review AI-generated English responses, craft expert language content, evaluate reasoning quality, and provide precise feedback to improve model accuracy.

The ideal candidate holds a Bachelor's degree in linguistics or related field, excellent English (C1/C2), and a track record in editorial QA, multilingualism, and AI tooling.