LLM Annotation Specialist - Execution (Tier 2/3)

Crescendo Staffing and Business Consulting Inc.; Quezon City; On-site; PHP 334,800 - 558,000; Full time

Job summary

A staffing and consulting firm is seeking an LLM Annotator – Execution (Tier 2 & Tier 3) to perform advanced annotation and quality assurance tasks for Large Language Models (LLMs). The ideal candidate will have at least one year of relevant experience and strong analytical skills. Key responsibilities include executing complex annotation tasks, evaluating LLM outputs, and collaborating on quality assurance activities. A Bachelor's degree in a related field is preferred, along with strong attention to detail and the ability to work independently.

Qualifications

• At least 1 year of LLM-related work experience, including annotation, evaluation, prompt review, or AI operations.
• Experience working with NLP concepts and AI safety guidelines is a plus.
• Ability to work independently in a structured, metrics-driven environment.

Responsibilities

• Execute complex text annotation, labeling, and classification tasks.
• Perform LLM output evaluation based on relevance and accuracy.
• Handle ambiguous inputs with sound judgment.
• Support quality assurance activities such as peer reviews and error analysis.
• Maintain productivity and quality metrics aligned with project standards.

Skills

Strong English comprehension

Attention to detail

Ability to follow guidelines

Analytical skills

Education

Bachelor’s degree in Linguistics, Communications, Computer Science, Data Science, Psychology, or a related field

Tools

Annotation tools

AI evaluation systems

Job description

A staffing and consulting firm is seeking an LLM Annotator – Execution (Tier 2 & Tier 3) to perform advanced annotation and quality assurance tasks for Large Language Models (LLMs). The ideal candidate will have at least one year of relevant experience and strong analytical skills. Key responsibilities include executing complex annotation tasks, evaluating LLM outputs, and collaborating on quality assurance activities. A Bachelor's degree in a related field is preferred, along with strong attention to detail and the ability to work independently.