Senior AI Content Evaluator & Quality Lead

Intelliswift - An LTTS Company; United States; Remote; USD 70,000 - 100,000; Full time

Job summary

Intelliswift - An LTTS Company is seeking a Content Specialist III to evaluate, improve, and shape AI content across diverse topics. The role focuses on high-quality, accurate model responses, requiring exceptional writing and editing skills and the ability to apply structured guidelines consistently.

The position is remote in the United States, with a 6+ month contract (W2). You will refine prompts, document evaluation outcomes, and collaborate cross-functionally to enhance AI behavior and

Qualifications

• Bachelor's degree or equivalent practical experience.
• 5+ years in writing, editing, journalism, content production, or related fields.
• Exceptional writing, editing, proofreading, and communication skills.
• Deep expertise in at least one subject area; apply it when evaluating content.
• Strong analytical thinking, judgment, and ability to apply guidelines.
• Attention to detail and commitment to quality.

Responsibilities

• Evaluate AI-generated responses across diverse subjects and conversation types.
• Test new model capabilities and document success cases, failures, and edge cases.
• Assess responses using detailed quality standards, scoring rubrics, and evaluation frameworks.
• Provide actionable feedback on model performance, reasoning quality, tone, factual accuracy, and instruction adherence.
• Refine prompts and evaluation criteria to improve output quality and consistency.
• Perform quality reviews of both human and AI-generated evaluations.
• Conduct fact-checking, content validation, and root-cause analysis on model failures.
• Collaborate with cross-functional teams to improve evaluation processes and model performance.
• Document findings clearly and communicate recommendations effectively.
• Adapt quickly to changing priorities and evolving project requirements.

Skills

Writing

Editing

Content Production

Technical Writing

Policy Analysis

Research

STEM

Education

Bachelor's degree or equivalent

Job description

Intelliswift - An LTTS Company is seeking a Content Specialist III to evaluate, improve, and shape AI content across diverse topics. The role focuses on high-quality, accurate model responses, requiring exceptional writing and editing skills and the ability to apply structured guidelines consistently.

The position is remote in the United States, with a 6+ month contract (W2). You will refine prompts, document evaluation outcomes, and collaborate cross-functionally to enhance AI behavior and