AI Safety & Guardrails Data Annotator — Remote

AI Data Innovations; Philippines; Remote; PHP 608,000 - 782,000; Full time

Job summary

AI Data Innovations is seeking technically literate data annotators to support an AI safety project focused on improving guardrails for an enterprise coding assistant. You will review and annotate multi-turn conversations that may include natural language, code, logs, and configuration files.

Your main task is to identify potential safety risks related to content moderation and prompt injection, while considering context and intent.

Qualifications

• Bachelor’s degree in Computer Science, Software Engineering, IT or related STEM field, or equivalent training.
• Ability to read and interpret basic code, configuration files, stack traces, and structured outputs.
• Basic understanding of application-security concepts (injection attacks, authentication bypass, backdoors).
• Professional-level English reading and comprehension.
• Strong analytical and contextual reasoning.
• Excellent attention to detail and ability to apply complex guidelines.
• Availability for the expected duration and weekly hours of the project.

Responsibilities

• Review multi-turn, code-related conversations involving user requests and AI-generated responses.
• Interpret code snippets, code changes, system logs, command-line instructions, and structured tool outputs.
• Identify and label potential prompt-injection attempts, such as instructions intended to override system rules or hidden malicious content.
• Identify content-moderation risks, including hateful, harmful, or illicit content.
• Evaluate the context and intent of technical language rather than relying only on individual keywords.
• Replace masked or redacted placeholders with realistic, neutral synthetic information when required.
• Follow detailed annotation guidelines and apply multi-level taxonomies consistently.
• Participate in regular calibration sessions and meet established quality and accuracy standards.
• Escalate unclear or ambiguous cases according to project procedures.

Skills

Code reading

Analytical thinking

Attention to detail

English proficiency

Education

Bachelor's degree in Computer Science/Software Engineering/Information Technology or related STEM

Tools

Label Studio

Prodigy

Job description

AI Data Innovations is seeking technically literate data annotators to support an AI safety project focused on improving guardrails for an enterprise coding assistant. You will review and annotate multi-turn conversations that may include natural language, code, logs, and configuration files.

Your main task is to identify potential safety risks related to content moderation and prompt injection, while considering context and intent.