Marketing AI Environment Architect

Obsidian; New York (NY); On-site; USD 120,000 - 170,000; Full time

Job summary

Obsidian in New York builds high‑fidelity simulated work environments to evaluate AI agents on real marketing tasks. You will design creator and influencer scenarios, including briefs, artifacts, and the judging criteria that separate strong responses from plausible but incorrect ones.

Your work will specify required documents, dashboards, personas, and tool states, write or review reference answers, and evaluate AI attempts against your rubric.

Qualifications

• Hands-on experience running creator or influencer programs.
• Ability to specify task briefs and judging criteria.
• Experience designing AI training environments or simulated cases.
• Rubric Academy or Rubric Bootcamp certification preferred.
• Clear written reasoning to justify decisions.

Responsibilities

• Design task briefs with the planted issue and decision points.
• Specify documents, dashboards, personas, and tool states required.
• Write or review reference answers and evaluation criteria.
• Review AI agent attempts and judge against your standard.
• Oversee multi-tool orchestration across tasks.

Skills

Creator program management

Platform familiarity

AI training environment design

Clear written reasoning

Disclosures & compliance knowledge

Education

Rubric Academy certification

Job description

Obsidian in New York builds high‑fidelity simulated work environments to evaluate AI agents on real marketing tasks. You will design creator and influencer scenarios, including briefs, artifacts, and the judging criteria that separate strong responses from plausible but incorrect ones.

Your work will specify required documents, dashboards, personas, and tool states, write or review reference answers, and evaluate AI attempts against your rubric.