Real-Time AI Quality Evaluator

Element Ops

Philippines

Remote

PHP 3,769,000 - 6,281,000

Full time

7 days ago

Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Element Ops is seeking an AI Quality & Evaluation Specialist to improve the reliability of an AI-powered platform used in real-time security operations. You will review AI alerts, label errors, and provide feedback to enhance performance.

The role emphasizes careful analysis, documentation, and collaboration with cross-functional teams. The ideal candidate has 3+ years in operations, QA, or data review, strong English communication, and comfort working remotely with US time zones.

Qualifications

Experience analyzing information and identifying errors.
Strong written English communication to document decisions andFeedback.
Ability to work independently, adapt to guidelines, and maintain accuracy.

Responsibilities

Review AI-generated alerts and actions for accuracy and relevance.
Label incorrect outputs and provide actionable feedback.
Document evaluation reasons and maintain logs in internal systems.
Evaluate correct outputs to identify successful decisions and quality standards.
Identify recurring errors and share findings with teams.
Maintain records of evaluations, error classifications, and feedback.
Apply critical thinking when reviewing AI outputs and flag unclear cases.
Collaborate with operations to support platform improvements.
Help refine evaluation criteria, guidelines, and workflows.