AI Japanese Language Quality Analyst for Prompts

Agency; United States; Remote; USD 60,000 - 110,000; Full time

Job summary

Agency in the United States seeks a linguistics specialist to evaluate language model outputs. You will verify factual accuracy, assess grammar, syntax, morphology across Japanese, and document error traces with clear, reproducible steps.

Responsibilities include challenging prompts, suggesting prompt engineering improvements and evaluation metrics, and demonstrating metacognitive communication by showing your work while analyzing language nuances and regional speech forms.

Qualifications

• Expertise in Japanese grammar, syntax, morphology, kanji, hiragana, katakana, phonology, and pragmatics.

Responsibilities

• Converse with language models on various language scenarios.
• Verify factual accuracy and logical soundness of model outputs.
• Capture reproducible error traces and document failure modes.
• Suggest improvements to prompt engineering and evaluation metrics.
• Challenge models on grammar, syntax, morphology, kanji, and honorifics.

Skills

Japanese grammar

Japanese syntax

Japanese morphology

Kanji

Hiragana

Katakana

Phonology

Pragmatics

Job description

Agency in the United States seeks a linguistics specialist to evaluate language model outputs. You will verify factual accuracy, assess grammar, syntax, morphology across Japanese, and document error traces with clear, reproducible steps.

Responsibilities include challenging prompts, suggesting prompt engineering improvements and evaluation metrics, and demonstrating metacognitive communication by showing your work while analyzing language nuances and regional speech forms.