Remote Task Designer for Enterprise Support AI

Alignerr Corp.; Amsterdam; Remote; EUR 34,000 - 83,000; Part time

Job summary

Alignerr is building a dataset of expert tasks that train and evaluate advanced AI agents on real enterprise work.

As a Task Author for the Customer Support / Success role, you will design and calibrate end-to-end support triage tasks — reading a ticket, checking account configuration, searching runbooks, and deciding between fix and escalation — that reflect the real judgment calls experienced support professionals make under ambiguity.

Qualifications

• Experienced support engineer, technical support specialist, or customer success engineer with hands‑on product support experience.
• Deep familiarity with real product failure modes, escalation paths, and support tooling.
• Ability to reason through ambiguous support scenarios and articulate why a given routing decision is correct.
• Comfortable defining verifiable correctness criteria — not just "good customer service" but an objectively defensible resolution or escalation decision.
• Strong written communication; tasks and rubrics must be precise enough to be evaluated without interpretation.

Responsibilities

• Author realistic support task prompts: customer issue triage, account configuration checks, runbook lookup, and fix-versus-escalation decisions.
• Write scoring rubrics that define the correct routing decision, resolution path, or escalation criteria in terms that can be objectively checked.
• Set up task environments with ticket queues, account records, runbooks, and system states that replicate a genuine support scenario.
• Solve each task yourself to confirm the scenario is realistic, the correct answer is clear, and the rubric captures the right reasoning.
• Calibrate task difficulty — adjust ticket ambiguity, account configuration complexity, or runbook depth until the task challenges the model appropriately.
• Review and correct AI-drafted task prompts or rubrics when provided.

Skills

Support engineering

Customer success

Product support

Tools

Ticketing systems

Knowledge bases

Runbooks

Job description

Alignerr is building a dataset of expert tasks that train and evaluate advanced AI agents on real enterprise work.

As a Task Author for the Customer Support / Success role, you will design and calibrate end-to-end support triage tasks — reading a ticket, checking account configuration, searching runbooks, and deciding between fix and escalation — that reflect the real judgment calls experienced support professionals make under ambiguity.