Social Media AI Training Architect

Obsidian; San Francisco (CA); On-site; USD 90,000 - 140,000; Full time

Job summary

Obsidian in San Francisco builds high-fidelity simulated work environments to evaluate AI agents on real marketing tasks. You will design and pressure-test Social Media environments: briefs, artifacts, judgments, and the errors a strong practitioner should avoid.

You will design tasks, specify required documents and tool states, write reference answers and evaluation criteria, and review AI agent attempts against your standards across diagnosis, prioritization, planning, QA, and reporting.

Qualifications

• Hands-on practitioner experience running brand social accounts.
• Fluent in Sprout Social or similar social management platform.
• Experience building AI training environments or RL simulations is strongly preferred.
• Clear written reasoning and ability to explain decisions.

Responsibilities

• Design task briefs for social media scenarios and the planted issues to test.
• Specify required documents, dashboards, personas, and tool states.
• Write or review reference answers and evaluation criteria.
• Review AI agent attempts and judge against standards.

Skills

Social media management

AI training environments

Clear written reasoning

English proficiency

Tools

Sprout Social

Job description

Obsidian in San Francisco builds high-fidelity simulated work environments to evaluate AI agents on real marketing tasks. You will design and pressure-test Social Media environments: briefs, artifacts, judgments, and the errors a strong practitioner should avoid.

You will design tasks, specify required documents and tool states, write reference answers and evaluation criteria, and review AI agent attempts against your standards across diagnosis, prioritization, planning, QA, and reporting.