Senior AI Model Evaluator & Prompt Architect

Linda Werner & Associates

United States

Remote

USD 90,000 - 120,000

Full time

5 days ago
Be an early applicant
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

Linda Werner & Associates seeks an experienced professional to test new AI model versions across diverse topics and conversation types, and to evaluate outputs against rubrics and quality standards.

You will write and refine system prompts that shape model personality, tone, and behavior, applying rigorous writing, editing, and analytical judgment in a fast-moving environment dedicated to quality and improvement.

Qualifications

  • 5+ years of experience in writing, editing, journalism, or related field.
  • 1+ year of hands-on AI experience preferred.
  • Bachelor’s degree or equivalent experience.

Responsibilities

  • Test new AI model versions across a variety of topics, use cases, and conversation types.
  • Evaluate model responses against established rubrics, guidelines, and quality standards.
  • Write and refine system prompts that help shape model personality, tone, and behavior.

Skills

AI Model Evaluation
Prompt Writing and Refinement
Fact Checking and Analytical Judgment

Education

Bachelor’s degree or equivalent experience

Job description

Linda Werner & Associates seeks an experienced professional to test new AI model versions across diverse topics and conversation types, and to evaluate outputs against rubrics and quality standards.

You will write and refine system prompts that shape model personality, tone, and behavior, applying rigorous writing, editing, and analytical judgment in a fast-moving environment dedicated to quality and improvement.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Content Specialist III (Fully Remote)
Content Specialist III (Fully Remote)

Linda Werner & Associates • United States

Remote
USD 90,000 - 120,000
AI Content Evaluator & Prompting Specialist
AI Content Evaluator & Prompting Specialist

Linda Werner & Associates • United States

Remote
USD 55,000 - 83,000
Health insurance
Health savings account
Life insurance
+2
Senior AI Evaluation & Prompting Specialist (Remote)
Senior AI Evaluation & Prompting Specialist (Remote)

Partner Company • United States

Remote
USD 90,000 - 120,000
Health coverage
Remote contract
Content Specialist III | AI Evaluation & Prompting (Fully Remote)
Content Specialist III | AI Evaluation & Prompting (Fully Remote)

Partner Company • United States

Remote
USD 90,000 - 120,000
Health coverage
Remote contract
AI Prompt Quality Evaluator & Feedback Analyst
AI Prompt Quality Evaluator & Feedback Analyst

AI Trainer Jobs • United States

Remote
USD 48,000 - 76,000
Remote AI Prompt Evaluator & Quality Assurance Specialist
Remote AI Prompt Evaluator & Quality Assurance Specialist

Crossing Hurdles • United States

Remote
USD 48,216 - 55,104
AI QA Trainer - LLM Evaluation - Freelance Project
AI QA Trainer - LLM Evaluation - Freelance Project

Meridial • United States

On-site
USD 8,265 - 89,544
Secure computer and high-speed internet required
Prompt Engineer
Prompt Engineer

Soothsayer Analytics • Livonia (MI)

On-site
USD 60,000 - 80,000
Remote AI Workflow Evaluator - Management Consultant
Remote AI Workflow Evaluator - Management Consultant

AI Trainer Jobs • United States

Remote
USD 41,000 - 76,000
1. AI - QA & Prompt Analyst
1. AI - QA & Prompt Analyst

Trinityaiboston • Boston (MA)

Hybrid
USD 110,000 - 150,000