Remote AI Content Strategist for Model Evaluation

Remote Co.; United States; Remote; USD 77,000 - 86,000; Part time

Job summary

Aquent is partnering with a visionary leader to advance AI technologies. The Content Specialist will drive hands-on experimentation and rigorous evaluation of AI models, shaping performance, personality, and user experience.

You will document failures and successes to guide product improvements, while ensuring high ethical and quality standards across AI systems. This temporary 6-month assignment offers remote work within the US, with hourly compensation of $56.14–$62.38 and W2 placement.

Qualifications

• 5+ years of professional experience in a content-focused field (writing, editing, journalism, production, linguistics, or STEM).
• 1+ year hands-on experience with AI models (prompting, annotation, evaluation, or red-teaming).
• A Bachelor’s degree or equivalent practical experience.
• Demonstrated strong writing and editing skills with ability to communicate complex ideas clearly.
• Proven fact-checking expertise against original sources and failure investigations.
• Exceptional clear communication and adaptability in a fast-paced environment.

Responsibilities

• Lead evaluation and refinement of cutting-edge AI models and products.
• Conduct hands-on experiments with new model versions and test across diverse topics and conversations.
• Document precise examples of model successes and failures for development teams.
• Assess model responses against rubrics and quality benchmarks, providing feedback on effectiveness.
• Craft and iterate system prompts to shape AI model personality, tone, and behavior.
• Perform quality assessments on human and automated evaluations to ensure compliance and high standards.

Skills

Content writing

Editing

Journalism

Linguistics

Policy

STEM

Coding

Education

Bachelor’s degree or equivalent practical experience

Job description

Aquent is partnering with a visionary leader to advance AI technologies. The Content Specialist will drive hands-on experimentation and rigorous evaluation of AI models, shaping performance, personality, and user experience.

You will document failures and successes to guide product improvements, while ensuring high ethical and quality standards across AI systems. This temporary 6-month assignment offers remote work within the US, with hourly compensation of $56.14–$62.38 and W2 placement.