Quality Assurance Specialist | $40/hr Remote | Mercor

Crossing Hurdles; Remote; USD 60,000 - 80,000; Part time

Job summary

A referral partner organization is seeking a Quality Assurance Specialist for a remote contract role. The position involves designing prompts for language model evaluation, conducting tests, and maintaining quality assurance standards. Ideal candidates will have a BS/BA degree, strong writing skills, and familiarity with AI tools like ChatGPT. This flexible role offers compensation ranging from $35 to $40 per hour.

Qualifications

• Strong writing skills, critical thinking, and instructional clarity required.
• Significant familiarity with ChatGPT or similar language tools necessary.
• Experience in teaching or research preferred.

Responsibilities

• Design and optimize prompts for language model evaluation.
• Conduct testing and grading of AI model outputs.
• Collaborate with team members in quality assurance processes.

Skills

Strong writing skills

Critical thinking

Ability to work independently

Familiarity with ChatGPT

Education

BS or BA degree from a reputable institution

Job description

Quality Assurance Specialist | $40/hr Remote | Mercor

Get AI-powered advice on this job and more exclusive features.

This range is provided by Crossing Hurdles. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$35.00/hr - $40.00/hr

At Crossing Hurdles, we work as a referral partner. We refer candidates to Mercor that collaborates with the world’s leading AI research labs to build and train cutting‑edge AI models.

Organization: Mercor

Position: Generalist Evaluator Expert

Referral Partner: Crossing Hurdles

Type: Hourly Contract

Compensation: $35–$40/hour

Location: Remote

Duration: Approximately 1 month

Commitment: 10‑40 hours/week, flexible and asynchronous

Role Responsibilities (Training support will be provided)

• Design and optimize detailed prompts with multiple constraints and clear instructions for language model evaluation
• Define and document evaluation standards and develop comprehensive rubrics for assessing correct responses in consumer contexts
• Conduct testing and grading by running prompts through AI models and assessing outputs against expectations
• Support benchmarking and quality assurance to ensure prompt rigor and consistency before integration into official evaluation sets
• Collaborate with team members in quality assurance review processes to maintain evaluation reliability

Requirements

• BS or BA degree from a reputable institution (completed or in progress)
• Strong writing skills, critical thinking, and instructional clarity
• Ability to work independently and meet deadlines
• Significant familiarity with ChatGPT or similar language tools for personal or professional use
• Experience in teaching or research is preferred
• Access to a desktop or laptop computer (Chromebooks are not supported)

Application process: (Takes 20 min)

• Upload resume
• AI interview based on your resume (15 min)

Seniority level

Mid‑Senior level

Employment type

Contract

Job function

• Quality Assurance
• Writing/Editing
• Research

Industries

• E‑Learning Providers
• Education
• Information Services

Referrals increase your chances of interviewing at Crossing Hurdles by 2x

Get notified about new Quality Assurance Specialist jobs in United States.

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.