Social Media Architect for AI Training Environments

Obsidian; Greater London; On-site; GBP 60,000 - 90,000; Full time

Job summary

Obsidian is building high-fidelity simulated work environments to evaluate AI agents in social media tasks. You will design and pressure-test Social Media environments, briefs, artifacts, and judgment criteria, ensuring rigorous evaluation of the AI agents' performance.

The role focuses on hands-on social media work, creating realistic scenarios, dashboards, and reviews. You will assess AI attempts, provide clear reasoning, and help advance the testing framework for brand social campaigns.

Qualifications

• Hands-on practitioner experience running brand social.
• Fluent in using Sprout Social or similar social management platforms.
• Experience in AI training environments, RL environments or simulated case studies preferred.

Responsibilities

• Design task briefs for social media challenges and specify required documents, dashboards, personas and tool states.
• Write or review reference answers and criteria to differentiate strong responses from plausible but wrong ones.
• Review AI agent attempts and judge them against your standards.

Skills

Brand social management

Social media analytics

Written reasoning

Tools

Sprout Social

Job description

Obsidian is building high-fidelity simulated work environments to evaluate AI agents in social media tasks. You will design and pressure-test Social Media environments, briefs, artifacts, and judgment criteria, ensuring rigorous evaluation of the AI agents' performance.

The role focuses on hands-on social media work, creating realistic scenarios, dashboards, and reviews. You will assess AI attempts, provide clear reasoning, and help advance the testing framework for brand social campaigns.