AI Strategy & Evaluation SME

Tap Growth ai; Manila; On-site; PHP 600,000 - 900,000; Full time

Job summary

GECO Asia is seeking a Business Research & AI Evaluation SME to join our Manila delivery centers. You will review AI-produced content, assess research processes, and help ensure AI-driven outputs meet real-world business needs for diverse clients.

The ideal candidate has a background in management consulting or business research, strong analytical skills, and comfort working with Excel and evaluation tools.

Qualifications

• Experience in management consulting with focus on business research and analysis.
• Strong understanding of how professionals approach research and analysis.
• Ability to assess AI-generated research processes and outputs.
• Strong analytical, critical-thinking, and problem-solving skills.
• Ability to evaluate whether AI outputs are relevant, accurate, and sufficient.

Responsibilities

• Review AI-generated content, research outputs, and answers against defined evaluation criteria.
• Evaluate query decomposition and determine whether an LLM appropriately breaks down complex business research questions into actionable research steps.
• Assess whether the LLM identifies and searches for the right information, sources, and data needed to answer a business research question.
• Evaluate whether AI evaluation criteria and benchmarks are meaningful, relevant, and sufficiently rigorous from a business perspective.
• Review and challenge AI use cases, classifications, and decision frameworks, and recommend clear, rule-based definitions where appropriate.
• Perform hands-on evaluations directly within the application or through Excel-based testing and evaluation files.
• Identify instances where an AI agent takes the wrong action, searches incorrectly, misses relevant information, or produces an unsuitable output.
• Provide clear, structured, and actionable qualitative feedback to improve AI/LLM performance.
• Assess AI outputs against the expectations of the target user persona, particularly business professionals, consultants, and researchers.
• Help identify gaps in AI-generated research processes and recommend improvements to make outputs more accurate, relevant, logical, and business-ready
• Collaborate with product, AI, research, and technical teams to translate business requirements into practical AI evaluation standards and guidelines.

Skills

Management consulting

Business research

Strategy research

Financial research

Analytical thinking

Critical thinking

Tools

Excel

Job description

GECO Asia is seeking a Business Research & AI Evaluation SME to join our Manila delivery centers. You will review AI-produced content, assess research processes, and help ensure AI-driven outputs meet real-world business needs for diverse clients.

The ideal candidate has a background in management consulting or business research, strong analytical skills, and comfort working with Excel and evaluation tools.