Overview
We are looking for Creative/Content Writers proficient in English language to support the evaluation and improve efficiency of large language models (LLMs).
Job Details
- Required Hours: 25-30 hours per week
- Project Start Date: August 2025
- Required Test: Versant for English language
- Eligibility: Only C1 & C2 scoring candidates in Versant test
- Apply: I will be assigning the Versant to resources daily and am looking for 50+ resources, so apply promptly.
Job Title
Content/Creative Writer
We are looking for Creative/Content Writers proficient in English language to support the evaluation and improve efficiency of large language models (LLMs).
Key Responsibilities
- Content Writing or Rubric Definition & Prompt Evaluation
- Update rubric definitions with region/language-specific examples to ensure cultural and linguistic relevance.
- Identify the need for additional rubrics tailored to specific languages or regional contexts.
- Review prompts translated from English into the target language and revise where translations appear unnatural or inaccurate.
- Writing of thoughtful prompts which can test the cultural awareness of LLM models.
- Rate prompt-response pairs using a standardized evaluation template based on rubrics and provide detailed justifications to base the findings.
- Document problematic outputs and annotate them with clear explanations of rubric violations or cultural insensitivities.
Required Qualifications
- Native proficiency in the target language and deep familiarity with cultural norms in the corresponding region.
- Experience in LLM evaluation, content moderation, or linguistic QA preferred.
- Strong attention to detail with the ability to identify subtle issues in language use, tone, and cultural references.
- Comfortable working in spreadsheets and evaluation templates.
- Bachelor's or Master’s degree or PhD resources in relevant stream are required.
Preferred Qualifications
- Prior experience with content/creative writing or prompt engineering or LLM testing.
- Familiarity with tools such as Gemini, ChatGPT or similar LLM platforms.
- Ability to clearly articulate reasoning behind rubric ratings or prompt edits.
Seniority level
Employment type
Job function
- Writing/Editing, Art/Creative, and Quality Assurance
Industries
- Business Consulting and Services and IT Services and IT Consulting