Welsh-Speaking JSON & Coding QA Specialist (Contract)

SmartRecruiters, Inc.; Florida City (FL); Remote; USD 34,000 - 83,000; Full time

Job summary

SmartRecruiters, Inc. seeks Welsh-speaking experts with strong JSON and coding skills for an AI evaluation project. The role involves real-time conversations, reviewing transcripts, and scoring responses for language and technical accuracy over a 2–3 month engagement.

Ideal candidates demonstrate exceptional attention to detail, excellent written communication, and the ability to validate JSON structure and formatting against project guidelines.

Qualifications

• Strong spoken-language proficiency: C1/C2-level fluency in the target language, verified by speaking/listening assessment.
• Technical literacy: JSON fluency required—reading, validating, troubleshooting and identifying formatting issues.
• Audio setup: capable of producing clear audio with no background noise.

Responsibilities

• Participating in live, real-time conversational scenarios with AI systems.
• Reviewing and labeling conversation transcripts.
• Evaluating AI-generated responses using structured rubrics and providing written justifications.
• Assessing responses for language quality, customer experience, technical accuracy, formatting, and JSON structure.
• Capturing session artifacts, including recordings, Session IDs, and tool-call/console logs.
• Environment preparation and tool verification before each session.

Skills

Welsh language fluency

JSON expertise

Technical evaluation

Customer service judgment

Job description

SmartRecruiters, Inc. seeks Welsh-speaking experts with strong JSON and coding skills for an AI evaluation project. The role involves real-time conversations, reviewing transcripts, and scoring responses for language and technical accuracy over a 2–3 month engagement.

Ideal candidates demonstrate exceptional attention to detail, excellent written communication, and the ability to validate JSON structure and formatting against project guidelines.