AI Marketing Environments Designer & Evaluator

Mercor; Toronto; On-site; CAD 70,000 - 110,000; Full time

Job summary

Mercor is building high-fidelity simulated work environments used to evaluate and improve AI agents on real marketing work.

Each environment reproduces a marketing org's actual tool surface — email, storage, CRM, project management, social media management, web analytics, AEO/SEO, ads, CMS, product analytics and support — populated with realistic documents, dashboards, personas and deliberately planted problems.

Qualifications

• Hands-on practitioner experience in product marketing with ownership of launches, positioning, and enablement.
• Comfort with CRM platforms (Salesforce), product analytics (Amplitude), and project trackers (Asana/Linear).
• Experience building AI training environments, RL environments, or simulated case studies is preferred.
• Rubric Academy or Rubric Bootcamp certifications are preferred.
• Clear, written reasoning showing why a decision is correct.

Responsibilities

• Design task briefs drawn from your past product marketing work, specifying what is tested and the decision expected.
• Specify required documents, dashboards, personas, and tool states for realistic task scenarios.
• Write or review the reference answer and scoring criteria that distinguish strong responses.
• Review AI agent attempts and judge them against your standard.

Skills

Product marketing experience

Launch ownership

Positioning

Enablement

Salesforce

Amplitude

Asana

Linear

AI training envs

RL environments

Simulated cases

Rubric Academy

Rubric Bootcamp

Written reasoning

Job description

Mercor is building high-fidelity simulated work environments used to evaluate and improve AI agents on real marketing work.

Each environment reproduces a marketing org's actual tool surface — email, storage, CRM, project management, social media management, web analytics, AEO/SEO, ads, CMS, product analytics and support — populated with realistic documents, dashboards, personas and deliberately planted problems.