Ai Coding Evaluator - Part Time - Remote

Anyone Ai

Almada

Remote

EUR 25,000 - 39,000

Full time

5 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Anyone AI is seeking multilingual experts to evaluate AI-generated responses for accuracy, clarity, and usefulness. You will review both customer service content and technical material, verifying JSON structure and adherence to project guidelines. Strong coding knowledge and detailed feedback are essential.

The role is remote, with project duration up to 3 months. Prior experience in AI evaluation or QA is nice to have; APIs and structured data familiarity are beneficial.

Qualifications

  • Fluency in one or more supported language varieties.
  • Solid understanding of JSON syntax, structure, validation, and troubleshooting.

Responsibilities

  • Review AI-generated customer service and technical content.
  • Evaluate outputs for clarity, helpfulness, naturalness, and quality.
  • Assess technical correctness using coding knowledge.
  • Read, validate, and troubleshoot JSON, identifying issues.
  • Check outputs for formatting accuracy and adherence to guidelines.
  • Provide clear, well-reasoned feedback of evaluations.

Skills

JSON validation
Coding knowledge
Multilingual proficiency
Attention to detail
Strong written communication
Guideline compliance

Job description

Help shape the future of AI by evaluating the technical accuracy, language quality, and usefulness of AI-generated responses.

Location: Remote

Project duration: up to 3 months

About the role At Anyone AI, we create high-quality training and evaluation data for frontier AI models.

We're looking for multilingual experts with coding knowledge and a solid understanding of JSON to evaluate AI-generated technical content and customer service responses.

In this role, you'll assess whether outputs are clear, helpful, natural, technically accurate, and aligned with project guidelines. Your evaluations will help improve both the customer experience and the technical reliability of AI systems.

What You'll Do
  • Review AI-generated customer service responses and technical content.
  • Evaluate responses for clarity, helpfulness, natural language, and overall quality.
  • Assess technical correctness using your coding knowledge.
  • Read, validate, and troubleshoot JSON, identifying structural and formatting issues.
  • Check outputs for formatting accuracy and adherence to project guidelines.
  • Provide clear, well-reasoned feedback explaining your evaluations.
What we're looking for
  • Fluency in one or more of the supported language varieties listed below.
  • A solid understanding of JSON, including syntax, structure, validation, and troubleshooting.
  • Coding knowledge sufficient to assess technical content and identify errors.
  • Strong judgment when evaluating customer service responses.
  • Excellent attention to detail and strong written communication skills.
  • Ability to follow detailed evaluation guidelines consistently.

Dutch — Netherlands

Welsh — United Kingdom

French — Canada

German — Germany

Greek — Greece

Nice to have
  • Previous experience in AI evaluation, quality assurance, or technical support.
  • Experience working with APIs and structured data.
  • A background in customer service, software development, or technical writing.
Voice response instructions

When completing the voice response, speak naturally and spontaneously, as if responding in real time. Do not pre-plan, write, or script your answer—we are evaluating natural voice cadence.

Responses may be up to one minute long. A few sentences are sufficient if that feels natural.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Coding Evaluator
AI Coding Evaluator

Anyone AI • Lisboa

Remote
EUR 21,000 - 39,000
Remote AI Coding Evaluator - 3-Month Contract
Remote AI Coding Evaluator - 3-Month Contract

Anyone Ai • Almada

Remote
EUR 25,000 - 39,000
Remote AI Coding & Content Evaluator
Remote AI Coding & Content Evaluator

Anyone AI Inc. • Lisboa

Remote
EUR 21,000 - 39,000
AI Agent Evaluator
AI Agent Evaluator

Anyone AI • Lisboa

Remote
EUR 28,000 - 48,000
Multilingual Audio Evaluator
Multilingual Audio Evaluator

Anyone AI • Lisboa

Remote
EUR 28,000 - 55,000
Quality Evaluator – Fluent English (Europe & LATAM)
Quality Evaluator – Fluent English (Europe & LATAM)

Anyone AI • Lisboa

Remote
EUR 8,600 - 15,000
Global Multilingual AI Evaluator (Remote)
Global Multilingual AI Evaluator (Remote)

Anyone AI Inc. • Lisboa

Remote
EUR 28,000 - 55,000
Coding Agent Evaluation Specialist - Portugal
Coding Agent Evaluation Specialist - Portugal

Thoth Ai • Portugal

Remote
EUR 34,000 - 69,000
AI Agent Evaluation Analyst (Freelance)
AI Agent Evaluation Analyst (Freelance)

Mindrift • Lisboa

Remote
EUR 31,180 - 44,408
Flexible remote work
Competitive rates
Experience in AI projects
Senior AI Coding Evaluator (Part-Time, Flexible Hours)
Senior AI Coding Evaluator (Part-Time, Flexible Hours)

G2i Inc. • Braga

On-site
EUR 60,000 - 85,000
Top locations