AI Content & Evaluation Specialist

Aquent; California (MO); Hybrid; USD 90,000 - 150,000; Full time

Job summary

Aquent is partnering with a visionary leader in AI to join a team shaping the future of intelligent systems. You will drive hands-on experimentation, evaluation, and refinement of next‑generation AI models, ensuring high quality, reliability, and ethical alignment across products used by millions.

Ideal candidates bring 5+ years in content‑focused roles, 1+ year with AI-model workflows (prompting, annotation, evaluation, red‑teaming), and a strong writing/editing capability.

Qualifications

• 5+ years of professional experience in a relevant content‑focused field such as writing, editing, journalism, production, linguistics, or a specialized subject matter like STEM, coding, or policy.
• 1+ year of hands‑on experience working directly with AI models, including prompting, annotation, evaluation, or red‑teaming.
• A Bachelor’s degree or equivalent practical experience.
• Demonstrated strong writing and editing skills, with an ability to communicate complex ideas clearly and concisely.
• Proven fact‑checking expertise, including verifying claims against original sources and conducting thorough failure investigations.
• Exceptional clear communication skills and adaptability in a fast‑paced, evolving environment.

Responsibilities

• Lead the evaluation and refinement of cutting‑edge AI models and products, contributing directly to their quality and performance.
• Conduct hands‑on experiments with new model versions, thoroughly testing across diverse topics and conversation types.
• Document precise examples of model successes and failures, providing actionable insights for development teams.
• Assess model responses against defined rubrics and quality benchmarks, offering critical feedback on the effectiveness and validity of these standards.
• Craft and iterate on system prompts to meticulously shape an AI model’s personality, tone, and overall behavior.
• Perform comprehensive quality assessments on both human and automated evaluations, ensuring compliance and maintaining high standards.

Skills

Writing & editing

Fact-checking

Communication skills

Content expertise (STEM/policy)

Prompting with AI models

Education

Bachelor's degree or equivalent

Job description

Aquent is partnering with a visionary leader in AI to join a team shaping the future of intelligent systems. You will drive hands-on experimentation, evaluation, and refinement of next‑generation AI models, ensuring high quality, reliability, and ethical alignment across products used by millions.

Ideal candidates bring 5+ years in content‑focused roles, 1+ year with AI-model workflows (prompting, annotation, evaluation, red‑teaming), and a strong writing/editing capability.