Content Specialist - Conversational AI Quality

Linda Werner & Associates; United States; Remote; USD 70,000 - 90,000; Part time

Job summary

A digital content consultancy is seeking a Conversational AI Content & Quality Specialist. In this remote position, you will focus on enhancing AI conversational quality by writing and evaluating varied content. Ideal candidates will possess over 6 years of journalism experience and strong skills in prompt engineering. Responsibilities include content creation, qualitative analysis, and collaboration with cross-functional teams. Competitive benefits offered.

Benefits

Dental insurance

Health insurance

Health savings account

Life insurance

Paid time off

Retirement plan

Vision insurance

Qualifications

• 6+ years in journalism, digital content strategy, or related fields.
• Demonstrated expertise in prompt engineering and AI tool usage.
• Strong editorial judgment with sensitive subject matter.

Responsibilities

• Write, edit, and review various content including AI model prompts.
• Perform qualitative annotation of AI model outputs.
• Design and refine system prompts to enhance AI performance.

Skills

Journalism experience

Prompt engineering

Editorial judgment

Excellent writing and editing skills

Spreadsheet proficiency

Ability to manage multiple priorities

Education

Bachelor’s degree

Tools

Google Sheets

MS Excel

Job description

We are seeking a highly skilled Conversational AI Content & Quality Specialist to join our team. In this role, you will write, review, edit, and evaluate content, with a focus on improving AI model conversational quality through expert prompt engineering and annotation. This position requires exceptional editorial judgment, deep experience with AI tools, and the ability to assess and enhance conversational experiences in emerging generative AI technologies.

Responsibilities:

• Write, edit, and review a variety of content, from creative copy to AI model prompts.

• Perform qualitative annotation and evaluation of AI model outputs, assessing conversationality and overall quality.

• Identify and address conversational quality issues through effective prompting practices.

• Design, test, and refine system prompts using clear, compelling natural language to improve AI performance.

• Apply and interpret guidelines with critical thinking, adapting to novel or ambiguous scenarios.

• Conduct analysis and produce actionable insights for cross-functional teams.

• Maintain high standards of accuracy and consistency when reviewing content at scale.

• Collaborate with content and product teams to enhance user experience.

• Support quality control for large datasets on nuanced topics such as politics, bias, gender, and religion.

• Work extended or weekend schedules as required.

Minimum Qualifications:

• 6+ years in journalism, digital content strategy, production, or related fields.

• Demonstrated expertise in prompt engineering, annotation, and AI tool usage.

• Strong editorial judgment and experience reviewing sensitive or nuanced subject matter.

• Excellent writing, editing, and communication skills (familiarity with AP Style preferred).

• Proficiency in spreadsheet tools (Google Sheets, MS Excel) and basic data visualization.

• Ability to work independently and manage multiple priorities in a fast-paced environment.

Preferred Qualifications:

• Knowledge of the social media landscape and platform trends.

• Storytelling expertise across text, audio, and video formats.

• Experience in multimedia content creation, photo editing, or video production.

• Background in creative writing or other content creation disciplines.

Education:

• Bachelor’s degree required.

Pursuant to the California Fair Chance Act, Los Angeles County Fair Chance Ordinance for Employers, Los Angeles Fair Chance Initiative for Hiring Ordinance, and San Francisco Fair Chance Ordinance, qualified applicants will be considered for assignment with arrest and conviction records. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness, meet client expectations, standards, and accompanying requirements, and safeguard business operations and company reputation.

Location: United States (Remote)

Role type: Contract 6 Month Position

Expected hours: 40 per week

Benefits:

• Dental insurance
• Health insurance
• Health savings account
• Life insurance
• Paid time off
• Retirement plan
• Vision insurance

Schedule:

• 8 hour shift
• Monday to Friday

Application Question(s):

• Do you or will you in the future require any sponsorship to work in the US?

Language:

• English (Required)