Content & Experience Evaluator

Horizontal Talent; Sacramento (CA); On-site; USD 51,000 - 99,000; Full time

Job summary

Horizontal Talent is seeking a contract content-evaluation specialist to improve member-facing search and AI experiences by reviewing recommendations and generated text. You will apply guidelines, annotate data, and document results with clear rationale to support quality improvements.

The role requires strong English writing, attention to detail, and the ability to work under deadlines. This client-focused position offers a structured evaluation framework and collaboration with cross-functional

Qualifications

• Experience evaluating content for AI training and quality improvement.
• Ability to summarize and assess creative content objectively.
• Excellent written English communication.
• Detail-oriented with deadline-driven work style.

Responsibilities

• Review and evaluate content recommendations and generated text to support AI training and quality improvement efforts.
• Apply established guidelines and independent judgment to capture nuance, context, and intent in creative content.
• Validate datasets used in AI and machine learning workflows for accuracy, completeness, and consistency.
• Identify patterns, edge cases, and potential issues that could affect model performance or member experiences.
• Document evaluation results and rationale in a clear, concise, and objective way.
• Collaborate with cross-functional partners to help improve dataset quality and relevance.
• Support evaluation work tied to search and AI-driven member experiences, including voice and search relevance initiatives.

Skills

Media background

Writing & editing

Content labeling

Metadata analysis

AI evaluation

Job description

Join a team focused on improving member-facing search and AI experiences through thoughtful content evaluation and expert judgment. This contract opportunity is ideal for someone with a deep background in media and a strong ability to review, annotate, and rate content with accuracy, consistency, and care.

Responsibilities

• Review and evaluate content recommendations and generated text to support AI training and quality improvement efforts.
• Apply established guidelines and independent judgment to capture nuance, context, and intent in creative content.
• Validate datasets used in AI and machine learning workflows for accuracy, completeness, and consistency.
• Identify patterns, edge cases, and potential issues that could affect model performance or member experiences.
• Document evaluation results and rationale in a clear, concise, and objective way.
• Collaborate with cross-functional partners to help improve dataset quality and relevance.
• Support evaluation work tied to search and AI-driven member experiences, including voice and search relevance initiatives.

Skills

• Background in media-related work such as writing, editing, content design, metadata analysis, or content labeling for AI.
• Deep knowledge of films and series across genres, markets, and the broader streaming landscape.
• Strong ability to summarize and assess creative content in a clear, objective, and structured way.
• Excellent written communication skills in English.
• Comfort working within defined guidelines and rubric-based evaluation frameworks.
• High attention to detail, reliability, and the ability to work in a deadline-driven environment.
• Ability to learn and use internal tools and systems effectively.

Preferred Skills

• Fluency in Spanish is strongly preferred.
• Experience working with large data catalogs.
• Prior experience reviewing datasets or supporting AI and machine learning workflows.
• Curious, collaborative, and open to feedback in a team-oriented environment.
• Ability to adapt to changing tools, processes, and priorities.

Horizontal Talent is committed to fostering a diverse, equitable, and inclusive workplace where people of all backgrounds can thrive. We value different perspectives and experiences, and we encourage qualified candidates to apply.

By applying for this position, you acknowledge and agree that Horizontal Talent may contact you regarding your application using automated technology, including phone calls, SMS/text messages, or email, which may be delivered by our virtual AI recruiter, Alex.

Applications will be accepted for 4 weeks. For those that join the team, we offer competitive compensation and benefits including medical, dental, vision, and retirement. The pay range for this role is $37 - $72 per hour based on qualifications and experience.