About GECO Asia
GECO Asia is a leading IT consultancy and technology solutions provider headquartered in Singapore, with a strong presence across Asia, including the Philippines, Indonesia, Malaysia, and China. With nearly two decades of industry experience, we specialize in delivering innovative technology solutions and providing highly skilled professionals to support our clients’ digital transformation initiatives.
Our Philippines operations include delivery centers in Manila and Iloilo, where we build and support high-performing teams for local and international clients.
At GECO Asia, we value innovation, collaboration, continuous learning, and career growth. Our professionals have the opportunity to work on global projects, gain exposure to emerging technologies, and contribute to solutions that shape the future of business and technology.
Business Research & AI Evaluation SME
Background
- Experience in management consulting, with a focus on business research and analysis, strategy research, and/or financial research.
- Strong understanding of how professional business users and strategy consultants approach research and analysis.
- Ability to assess whether an AI-generated research process, methodology, and output are relevant and practical for real-world business users.
- Strong analytical, critical-thinking, and problem-solving skills.
- Ability to evaluate complex business questions and determine whether the information gathered by an AI system is relevant, accurate, and sufficient.
What You’ll Do
- Review AI-generated content, research outputs, and answers against defined evaluation criteria.
- Evaluate query decomposition and determine whether an LLM appropriately breaks down complex business research questions into actionable research steps.
- Assess whether the LLM identifies and searches for the right information, sources, and data needed to answer a business research question.
- Evaluate whether AI evaluation criteria and benchmarks are meaningful, relevant, and sufficiently rigorous from a business perspective.
- Review and challenge AI use cases, classifications, and decision frameworks, and recommend clear, rule-based definitions where appropriate.
- Perform hands-on evaluations directly within the application or through Excel-based testing and evaluation files.
- Identify instances where an AI agent takes the wrong action, searches incorrectly, misses relevant information, or produces an unsuitable output.
- Provide clear, structured, and actionable qualitative feedback to improve AI/LLM performance.
- Assess AI outputs against the expectations of the target user persona, particularly business professionals, consultants, and researchers.
- Help identify gaps in AI-generated research processes and recommend improvements to make outputs more accurate, relevant, logical, and business-ready.
- Collaborate with product, AI, research, and technical teams to translate business requirements into practical AI evaluation standards and guidelines.
Ideal Candidate
- Background in management consulting, business research, strategy consulting, financial research, or a related field.
- Strong experience conducting structured research and analyzing complex business questions.
- Excellent understanding of how consultants and business professionals evaluate information and make decisions.
- Strong attention to detail and ability to identify inaccuracies, gaps, inconsistencies, and irrelevant information.
- Comfortable working with Excel and research/evaluation tools.
- Familiarity with AI, LLMs, generative AI, prompt evaluation, or AI-agent workflows is highly advantageous.
- Excellent written and verbal communication skills.
- Able to provide objective, structured, and actionable feedback.
- Comfortable working independently while collaborating with cross-functional teams.