Quality Analyst - AI Training (US)

Braintrust; United States; Remote; USD 26,000 - 37,000; Full time

Job summary

Braintrust is seeking detail-oriented Quality Analysts to evaluate chatbot responses and help improve AI systems. The role is fully remote for US-based contributors with a 16-week project duration and start immediately.

You'll compare responses for accuracy and clarity, document findings, and work with quality teams to resolve questions. Requires 3+ years in QA, strong analytical skills, and comfort with AI tools and online platforms.

Qualifications

• 3+ years in QA, data annotation or related testing.
• Strong analytical and communication skills.
• Detail-oriented with ability to follow evaluation guidelines.
• Comfort with AI tools, chatbots and online platforms.
• Experience with chatbot evaluation or data-quality projects is a plus.

Responsibilities

• Compare responses for accuracy, relevance, completeness, and clarity.
• Identify errors and provide structured feedback and final assessments.
• Apply review guidelines and document findings.
• Meet project quality, productivity, and turnaround goals.

Skills

Quality assurance

Data annotation

Analytical thinking

Written communication

Attention to detail

Independent work

Job description

• Rate: $23/hr
• Hours: 40 hours / week
• Experience: 3 - 5 years
• Location: Argentina | Belize | Bolivia + 15 more

We're looking for detail-oriented Quality Analysts to evaluate and compare chatbot responses and help improve AI systems.

What you'll do

• Compare responses for accuracy, relevance, completeness, clarity and adherence to evaluation guidelines.
• Identify subtle errors, inconsistencies and missing information, and provide clear, structured feedback and final assessments.
• Apply review guidelines consistently, document findings and work with quality teams to resolve questions or elevate complex cases.
• Meet project quality, productivity and turnaround expectations.

What you'll bring

• 3+ years of experience in quality assurance, data annotation, content evaluation, testing or a similar role.
• Strong analytical, critical-thinking and problem-solving skills, with excellent written and verbal communication.
• Attention to detail and the ability to follow detailed evaluation guidelines, work independently and manage multiple tasks.
• Comfort working with AI tools, chatbots and online platforms.
• Experience with chatbot evaluation, LLM testing or data-quality projects is a plus.

Engagement

Fully remote for contributors based in the United States. Expected project duration is 16 weeks, with an immediate start. You must be available for 8 hours per day, five days per week, including weekends as required, with two weekdays off and at least four hours of overlap with Pacific Time. Actual workload is project-dependent.

Company: Quality Analyst - AI Training (US)
Location: New
United States only