AI Data Operations Specialist | Up to $5500 | Fintech MNC

RecruitFirst; Santo Niño 1st; On-site; PHP 2,306,000 - 3,843,000; Full time

Job summary

RecruitFirst is seeking an AI annotation specialist to support model evaluation, data work, and workflow development. You will collaborate with cross‑functional teams and external partners to ensure high‑quality annotations and scalable processes.

The role involves designing prompts, building data pipelines, and maintaining guidelines across diverse domains. Strong English skills and a passion for AI are essential, with a 1‑year contract and extension opportunities.

Qualifications

• Bachelor's degree or higher in Computer Science, Data Science, Statistics, or related field.
• Hands-on experience designing, testing, and refining prompts for large language models.
• Proficiency in Python for data processing, analysis, and workflow automation.
• Proficient in SQL for data querying and analysis.
• Strong analytical skills with attention to detail.
• Ability to collaborate across teams and write clear guidelines.

Responsibilities

• Support model evaluation, training, and user growth projects by implementing workflows and annotation guidelines.
• Collaborate with product managers, project owners, researchers, and external partners.
• Communicate progress, bottlenecks, and risks promptly, and propose corrective actions.
• Audit annotations for accuracy and quality, and provide actionable feedback.
• Maintain annotation guidelines, documentation, and example libraries across domains.
• Assist exploratory AI projects through hands-on annotation and workflow testing.
• Develop tools and AI workflows for automation, data analysis, and format conversion.
• Design, test, and refine prompts, reusable AI skills, and agent workflows.
• Use Python, SQL, and data visualization to analyze annotation quality and model performance.
• Identify error trends and performance gaps; monitor data pipelines and inform guideline updates.
• Stay informed about advances in LLMs, AI agents, and evaluation methods.
• Research emerging technologies to improve tools, workflows, and data quality.

Skills

Python

SQL

Pandas

NumPy

Data visualization

Analytical skills

Prompt design

Collaboration

English proficiency

Education

Bachelor's degree or higher in CS/DS/Statistics

Job description

Location:Raffles Place

Salary:Up to $5500

Duration:1 year contract, subject to extension/conversion

Working Hours:5 days a week, 9am-6pm

Responsibilities

• Support model evaluation, training, and user growth projects by implementing project workflows and annotation guidelines to meet agreed objectives, timelines, and quality standards.

• Collaborate with product managers, project owners, researchers, and external partners.

• Communicate progress, bottlenecks, and risks promptly, and propose corrective actions as needed.

• Conduct systematic quality audits of annotations delivered by external partners to ensure accuracy, content quality, and alignment with project requirements and training objectives.

• Maintain clear audit records, identify recurring errors and quality risks, and provide actionable feedback to improve annotation quality and consistency.

• Help develop and maintain annotation guidelines, technical documentation, and example libraries across domains such as reasoning, general knowledge, STEM, and humanities.

• Support exploratory AI projects through hands-on annotation and workflow testing, helping translate emerging requirements into consistent, scalable processes.

• Develop and maintain code-based tools and AI workflows for process automation, data analysis, format conversion, and model capability enhancement.

• Design, test, and refine prompts, reusable AI skills, and agent workflows, and support their debugging, evaluation, deployment, and ongoing improvement across relevant platforms.

• Use Python, SQL, statistical analysis, and data visualization to analyze annotation quality, model performance, and dataset coverage.

• Identify error trends and performance gaps, monitor data pipeline health, and collaborate with model trainers and researchers to generate actionable insights that inform guideline updates, training strategies, and improvements to training data.

• Stay informed about advances in large language models, AI agents, and model evaluation methods.

• Research emerging technologies, competitor approaches, and industry practices to identify and help implement practical improvements to tools, workflows, and data quality.

Requirements

• Bachelor's degree or higher, preferably in Computer Science, Data Science, Statistics, or a related field.

• Professional working proficiency in English, spoken and written, with the ability to collaborate across teams, understand and write project guidelines, and perform bilingual data and annotation tasks.

• Hands-on experience designing, testing, and refining prompts for large language models, with the ability to evaluate model outputs against task requirements and improve prompts based on identified issues.

• Proficiency in Python for data processing, analysis, and workflow automation, including familiarity with pandas, NumPy, and common data visualization libraries; ability to use SQL to query and analyze data.

• Strong analytical skills and attention to detail, with the ability to systematically identify data quality issues, recurring errors, and anomalies, and propose clear, actionable improvements.

• A strong interest in AI, large language models, and their practical applications, with a willingness to learn new technologies and apply them to improve tools and workflows.
  

We regret to inform you only shortlisted candidates will be notified.