Content Writer & AI Evaluation Specialist (UK/US)

Sidequest

United States

Remote

USD 49,000 - 70,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Sidequest is seeking a Content Writer & AI Evaluation Specialist for a fully remote contract. You will craft prompts and reference content for LLM training, then assess model outputs for fluency, factuality, creativity, and bias.

This hybrid role blends production and evaluation, with 40 hours per week over 3–6 months. A strong English writing background and rubric experience are essential, along with independent time management and adaptability across styles.

Qualifications

  • 3+ years of professional English content writing, copywriting, or editing.
  • Hands-on experience evaluating LLM outputs against rubrics.
  • Prompt engineering and adversarial prompt design.
  • Ability to write and adapt across multiple styles, tones, and registers.
  • Independent time management on batched deadlines.

Responsibilities

  • Write prompts designed to stress a specific capability and produce gold-standard responses.
  • Evaluate model outputs for fluency, coherence, factuality, creativity, and bias using rubrics.
  • Provide justification for scores to guide researchers.

Skills

English writing
LLM evaluation
Prompt engineering
Multi-style writing
Time management

Education

Bachelor's degree (English/Creative Writing/Linguistics/CS)

Job description

AfterQueryListed Sep 25, 2025# Content Writer & AI Evaluation Specialist (UK/US)$43/hrrate as listedWorkload: 40 hrs/weekEngagement: Project-basedLocation: WorldwideField: CreativeWrite and rewrite prompts, responses, and reference content for LLM training, then evaluate model output for fluency, factuality, creativity, and bias. AfterQuery runs this as a full-time remote contract of 3–6 months at an observed $43/hr.---## What the work involvesThis is a hybrid writing and evaluation seat. Roughly half the day is production: authoring prompts designed to stress a specific capability (tone control, persona consistency, structural constraints, refusal edge cases) and writing gold-standard responses that a model should aspire to. The other half is assessment: reading model output against a rubric and scoring it on fluency, coherence, factuality, creativity, and bias, then writing the justification that makes your score usable by a researcher. Expect batches with defined turnaround, periodic rubric revisions mid-project, and calibration rounds where your scores are compared against other annotators'.The feedback you write matters more than the score itself. \"Response 2 is better\" is worthless; \"Response 2 maintains the second-person register the prompt established, while Response 1 drifts into third person at paragraph three and introduces a factual claim about the 1974 statute that the source does not support\" is the deliverable.## What the platform screens for* **Verifiable writing history.** Three or more years in English content writing, copywriting, or editorial work — named outlets, clients, or in-house roles, and what you actually produced.* **Range across register.** Whether you can move between technical explainer, brand voice, and narrative prose without collapsing everything into one house style.* **Concrete LLM experience.** Not \"I use ChatGPT daily\" but specific failure modes you have observed and can describe: sycophancy, hedging, invented citations, instruction drift over long context.* **Rubric discipline.** Whether you can hold a stated criterion even when your taste disagrees with it, and flag the conflict rather than silently rescore.* **Real availability.** The listing asks for 40 hours/week across 3–6 months. Screens probe this directly and inconsistency here is a common rejection reason.## LogisticsFully remote and largely asynchronous, with adaptable hours — but the 40-hour commitment is genuine, not nominal, and this is not designed to sit alongside another full-time role. Engagements run 3–6 months on contract. AfterQuery is YC-backed and places contributors on projects for a large AI lab partner; work is batched through their platform. UK and US candidates are the stated target. Bilingual capability in Chinese, Spanish, Portuguese, Arabic, French, or German is preferred, not required.## What they look for* 3+ years professional English content writing, copywriting, or editing* Hands-on experience evaluating LLM outputs against rubrics* Bachelor's degree in English, Creative Writing, Linguistics, Computer Science, or related field* Prompt engineering and adversarial prompt design* Ability to write and adapt across multiple styles, tones, and registers* Independent time management on batched deadlines
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Content Writer & AI Evaluation Specialist (UK/US)
Content Writer & AI Evaluation Specialist (UK/US)

AfterQuery • United States

Remote
USD 34,000 - 55,000
Remote work
Flexible hours
Extended contract
Lawyer/Legal Writer
Lawyer/Legal Writer

Micro1 • United States

Remote
USD 83,000 - 124,000
Generalist Writer
Generalist Writer

Remotebridge • United States

Remote
USD 34,000 - 69,000
Remote AI Content Writer & Evaluation Specialist
Remote AI Content Writer & Evaluation Specialist

Sidequest • United States

Remote
USD 49,000 - 70,000
Journalist/Writer
Journalist/Writer

Remotebridge • United States

Remote
USD 55,000 - 83,000
LLM Content Evaluation Analyst
LLM Content Evaluation Analyst

OpenTrain AI, Inc. • United States

Remote
USD 62,000 - 124,000
Remote work
English Language Expert
English Language Expert

SME Careers • Baltimore (MD)

Remote
USD 34,000 - 55,000
English Language Expert
English Language Expert

SME Careers • San Jose (CA)

Remote
USD 28,000 - 83,000
English Language Expert
English Language Expert

SME Careers • Cedar Rapids (IA)

Remote
USD 34,000 - 55,000
English Language Expert
English Language Expert

SME Careers • San Antonio (TX)

Remote
USD 34,000 - 55,000