LLM Power User & MCP Specialist: Plugin-Driven Tasks

Mercor; New York (NY); On-site; USD 60,000 - 90,000; Part time

Job summary

Mercor is seeking advanced LLM power users to evaluate AI systems using MCP and plugins for real-world personal life tasks. This role focuses on tasks across health, travel, planning, home services, and career search, leveraging tools like Google Drive, Notion, and Expedia.

You will record your screen and provide explanations of AI performance, with high emphasis on context and practical outputs. The ideal candidate uses AI heavily in daily life, has 6+ months of LLM history, and is willing to

Qualifications

• US-based only.
• Experience using LLM plugins/connectors such as Google Drive, Expedia, Notion.
• Active LLM account with 6+ months history.
• Willingness to sign data-share consent via DocuSign.
• Experience using AI for multi-step planning, research, or personal workflows.
• Strong written judgment and attention to detail.
• Experience writing and evaluating against rubrics.

Responsibilities

• Evaluate AI systems on complex personal-life tasks.
• Create realistic prompts for multi-step personal-life tasks.
• Execute tasks and record your screen (required).
• Use personal plugins/connectors while completing actions.
• Write clear explanations of AI successes and failures.
• Judge practicality and personalization of AI outputs.
• Identify context misses, overreach, or incorrect tool use.
• Create and apply detailed rubrics to assess model performance.

Skills

MCP experience

Plug‑in / connector usage

LLM product usage

Strong written judgment

Tools

Google Drive

Notion

Expedia

Job description

Mercor is seeking advanced LLM power users to evaluate AI systems using MCP and plugins for real-world personal life tasks. This role focuses on tasks across health, travel, planning, home services, and career search, leveraging tools like Google Drive, Notion, and Expedia.

You will record your screen and provide explanations of AI performance, with high emphasis on context and practical outputs. The ideal candidate uses AI heavily in daily life, has 6+ months of LLM history, and is willing to