Welsh-Speaking JSON & Coding Evaluator (Contract)

Lifted, an Upwork Company™; Sheffield; On-site; GBP 36,000 - 47,000; Full time

Job summary

Enterprise client in the UK seeks Welsh-speaking coding experts with JSON expertise to evaluate AI-generated outputs in audio form. You will join a short-term project, working on real-time conversations, reviewing transcripts, and judging language quality and technical accuracy.

Applicants must pass a basic assessment and demonstrate CEFR-level fluency. Flexibility in schedule and potential for additional work beyond the initial 2–3 months are offered based on performance.

Qualifications

• Pass a basic computational concepts assessment focusing on JSON structures, function, reasoning, and language proficiency.
• Strong spoken-language proficiency at CEFR C1/C2 verified by assessment.
• Technical literacy: reading, validating, troubleshooting JSON structures.

Responsibilities

• Participate in live, real-time conversations with AI systems.
• Review transcripts and label conversations for quality.
• Evaluate AI responses for language quality, UX, and technical accuracy with structured rubrics.
• Capture artifacts like recordings, Session IDs, and tool-call logs.
• Prepare environment and verify tools before each session.

Skills

JSON fluency

Welsh language

Live evaluation

Attention to detail

Job description

Enterprise client in the UK seeks Welsh-speaking coding experts with JSON expertise to evaluate AI-generated outputs in audio form. You will join a short-term project, working on real-time conversations, reviewing transcripts, and judging language quality and technical accuracy.

Applicants must pass a basic assessment and demonstrate CEFR-level fluency. Flexibility in schedule and potential for additional work beyond the initial 2–3 months are offered based on performance.