AI/ML Evaluation Specialist — System & Pattern Insight

Welo Data; Manila; On-site; PHP 432,000 - 605,000; Full time

Job summary

Welo Data is seeking analytical AI/ML Evaluators to review and evaluate complex AI system behaviour using expert human judgment. You will assess AI outputs, telemetry, and signals to identify meaningful patterns and distinguish legitimate activity from bot activity.

The role requires strong AI/ML knowledge, data analysis skills, and careful documentation of decisions to support AI system training and improvement.

Qualifications

• Educational background or equivalent experience in AI/ML/CS/Data Science/Statistics/Engineering or related field.
• Experience working with AI/ML systems, machine learning models, AI evaluation, data analysis, or technical system analysis.
• Strong understanding of core AI and machine learning concepts.
• Ability to analyse complex technical data, system behaviour, and patterns.
• Strong written English comprehension and documentation skills.

Responsibilities

• Review and evaluate AI system behaviour, outputs, and relevant technical data according to project guidelines.
• Analyse system telemetry, event data, signals, and other technical information to identify meaningful patterns.
• Evaluate patterns and signals to distinguish legitimate user activity from automated/bot activity.
• Apply AI/ML knowledge and expert human judgment on complex or ambiguous cases.
• Document decisions and supporting reasoning clearly when required.

Skills

AI/ML concepts

Data analysis

Machine learning

Analyzing technical data

Education

AI/ML/CS/Data Science/Statistics/Engineering background

Job description

Welo Data is seeking analytical AI/ML Evaluators to review and evaluate complex AI system behaviour using expert human judgment. You will assess AI outputs, telemetry, and signals to identify meaningful patterns and distinguish legitimate activity from bot activity.

The role requires strong AI/ML knowledge, data analysis skills, and careful documentation of decisions to support AI system training and improvement.