Remote Shopify Annotation Specialist

Talanto; Northern (KY); Hybrid; USD 55,000 - 69,000; Full time

Job summary

Talanto in the United States is seeking a Shopify Shop App Annotator contractor to evaluate shopper conversations, including tool calls and outcomes, and to identify the turn that received a thumbs-down.

You will classify issues with primary and secondary tags, and write concise comments explaining intent, actions, and tagging rationale; work independently and asynchronously to ensure tagging consistency across conversations.

Qualifications

• Rule discipline to apply a fixed taxonomy consistently.
• Comfort reading structured traces to understand agent actions.
• Restraint under ambiguity to use the unknown label appropriately.

Responsibilities

• Evaluate full shopper-agent conversations, including tool calls and their outcomes.
• Identify the specific turn that received a thumbs-down from the shopper.
• Classify the issue with a primary domain tag and a specific secondary tag.
• Write concise comments explaining the shopper's intent, the agent's actions, and the rationale for the tags.

Skills

Rule discipline

Comfort reading structured traces

Restraint under ambiguity

Job description

Talanto in the United States is seeking a Shopify Shop App Annotator contractor to evaluate shopper conversations, including tool calls and outcomes, and to identify the turn that received a thumbs-down.

You will classify issues with primary and secondary tags, and write concise comments explaining intent, actions, and tagging rationale; work independently and asynchronously to ensure tagging consistency across conversations.