AI QA Specialist — Remote, 4-Day Week, Edge-Case Testing

Chagible AI Lab; Singapore; Remote; SGD 42,000 - 68,000; Full time

Benefits offered by this job

Remote work

Leadership growth

Job summary

Chagible AI Lab is seeking a detail-oriented QA Specialist to ensure AI-driven applications function reliably across prompts, edge cases, and real-world scenarios. This remote freelance role emphasizes ownership of AI quality, safety, and output consistency before and after deployment.

You will collaborate with developers and prompt engineers to refine and validate improvements, monitor performance, and document issues with clear reproduction steps.

Qualifications

• QA methodologies for Generative AI, including prompt and output validation.
• Experience testing AI models, LLM-powered applications, or conversational systems.
• Understanding of prompt engineering and multi-turn interaction testing.
• Ability to identify hallucinations, bias, and safety risks in AI outputs.

Responsibilities

• Conduct structured testing across prompts, outputs, and edge case scenarios.
• Validate response accuracy, consistency, and contextual relevance.
• Test prompt flows, system instructions, and multi-turn interactions.
• Identify hallucinations, bias, safety risks, and output inconsistencies.
• Perform pre-deployment and post-deployment validation checks.
• Monitor logs, errors, and failure cases in AI responses.
• Assess latency, token usage, and response stability.
• Document issues with prompts, outputs, and reproduction steps.
• Evaluate data/annotations quality produced by AI trainers.
• Collaborate with developers and prompt engineers to refine improvements.

Skills

QA methodologies for Generative AI

Testing AI models / LLM-powered apps

Prompt engineering concepts

Edge-case anticipation

Job description

Chagible AI Lab is seeking a detail-oriented QA Specialist to ensure AI-driven applications function reliably across prompts, edge cases, and real-world scenarios. This remote freelance role emphasizes ownership of AI quality, safety, and output consistency before and after deployment.

You will collaborate with developers and prompt engineers to refine and validate improvements, monitor performance, and document issues with clear reproduction steps.