Marketing Analytics Expert - AI Environments

Obsidian; San Francisco (CA); On-site; USD 120,000 - 160,000; Full time

Job summary

Obsidian is building high-fidelity simulated work environments to test AI agents in marketing analytics. You will help design briefs, artifacts, and evaluation criteria that reveal where a strong practitioner shines and where errors occur.

We value hands-on marketing analytics experience with GA4, Amplitude, Salesforce, and ad platform reporting, plus clear written reasoning. Experience building AI training or RL environments is a strong plus; Rubric Bootcamp certification is preferred.

Qualifications

• Hands-on practitioner experience in marketing analytics.
• Familiar with GA4, Amplitude, Salesforce, and ad platform reporting.
• Experience designing AI training environments or simulated case studies is preferred.
• Strong written reasoning.

Responsibilities

• Design task briefs drawn from marketing analytics work, including what is being tested.
• Specify documents, dashboards, personas and tool states required.
• Write or review reference answers and criteria for strong vs. plausible responses.
• Review AI agent attempts and judge against your standard.

Skills

Marketing analytics experience

Written reasoning

Task design and evaluation

Tools

Google Analytics 4

Amplitude

Salesforce

Ad platform reporting

Job description

About the work

We are building high-fidelity simulated work environments used to evaluate and improve AI agents on real marketing work. Each environment reproduces a marketing org's actual tool surface — email, storage, CRM, project management, social media management, web analytics, AEO/SEO, ads, CMS, product analytics and support — populated with realistic documents, dashboards, personas and deliberately planted problems.

You will help design and pressure-test the Marketing Analytics environments: the briefs, the artifacts, the judgment calls a strong practitioner would make, and the errors a weaker one would miss.

What you will do

• Design task briefs drawn from work you have actually done in marketing analytics, including what the task is really testing — the planted issue and the decision a strong practitioner should reach
• Specify the documents, dashboards, personas and tool states a realistic version of that task requires
• Write or review the reference answer and the criteria that separate a strong response from a plausible-but-wrong one
• Review AI agent attempts and judge them against your own standard

Tasks span the capabilities we measure: diagnosing what happened from messy or conflicting data, prioritizing and making tradeoffs, planning and executing, QA and reconciliation, triage and escalation, research and evaluation, reporting, and orchestrating multi-step work across several tools.

Marketing Analytics scope

Anomaly detection, channel-performance synthesis, cross-source reconciliation, attribution and incrementality reading, and reporting that supports an actual decision.

Who we are looking for

• Hands-on practitioner experience in marketing analytics — you have owned this work, not only managed people who do it
• Fluent in the tools of the domain: Google Analytics 4, a product analytics tool such as Amplitude, a CRM such as Salesforce, and ad platform reporting
• Prior experience building AI training environments, RL environments or simulated case studies is strongly preferred
• Rubric Academy or Rubric Bootcamp certification is strongly preferred
• Clear written reasoning — much of the value is in explaining why a decision is right

Screening

Applicants complete a short multiple-choice knowledge screener specific to this sub-domain before review.