AI Content Quality & Experience Evaluator

Horizontal Talent; Sacramento (CA); On-site; USD 51,000 - 99,000; Full time

Job summary

Horizontal Talent is seeking a contract content-evaluation specialist to improve member-facing search and AI experiences by reviewing recommendations and generated text. You will apply guidelines, annotate data, and document results with clear rationale to support quality improvements.

The role requires strong English writing, attention to detail, and the ability to work under deadlines. This client-focused position offers a structured evaluation framework and collaboration with cross-functional

Qualifications

• Experience evaluating content for AI training and quality improvement.
• Ability to summarize and assess creative content objectively.
• Excellent written English communication.
• Detail-oriented with deadline-driven work style.

Responsibilities

• Review and evaluate content recommendations and generated text to support AI training and quality improvement efforts.
• Apply established guidelines and independent judgment to capture nuance, context, and intent in creative content.
• Validate datasets used in AI and machine learning workflows for accuracy, completeness, and consistency.
• Identify patterns, edge cases, and potential issues that could affect model performance or member experiences.
• Document evaluation results and rationale in a clear, concise, and objective way.
• Collaborate with cross-functional partners to help improve dataset quality and relevance.
• Support evaluation work tied to search and AI-driven member experiences, including voice and search relevance initiatives.

Skills

Media background

Writing & editing

Content labeling

Metadata analysis

AI evaluation

Job description

Horizontal Talent is seeking a contract content-evaluation specialist to improve member-facing search and AI experiences by reviewing recommendations and generated text. You will apply guidelines, annotate data, and document results with clear rationale to support quality improvements.

The role requires strong English writing, attention to detail, and the ability to work under deadlines. This client-focused position offers a structured evaluation framework and collaboration with cross-functional