SMB AI Power User — Competitive Eval · Invisible Tech Invisible Tech · 40-50/hr · remote in US · 1w ago 40-50/hr remote in US 1w ago

Benture; United States; Hybrid; USD 55,000 - 69,000; Part time

Job summary

Meridial is seeking a hands-on SMB owner or operator to join a Competitive Evaluations team, working remotely in the US. You will test an AI assistant subscription against competitors using real small-business tasks like ad copy, content planning, and customer messaging while surfacing gaps for paying subscribers.

You will build SMB test cases and write reproducible evaluation reports, identifying failure modes and assessing value against rivals.

Qualifications

• Owner or operator of a small or medium business (1–200 employees).
• Daily, habitual use of generative AI tools for business operations and marketing.
• Active organic presence on Instagram and Facebook, personally managed.
• Hands-on Meta paid advertising experience with real budget.
• Based in the United States and authorized to work here.
• Availability of up to 40 hours per week to meet deliverables.

Responsibilities

• Run head-to-head prompts and multi-turn workflows across competing AI assistants using real small-business tasks.
• Build and maintain a library of realistic SMB test cases spanning creative, organic content, customer communications, competitor research, pricing, scheduling, and more.
• Identify and document failure modes: wrong answers, unnecessary refusals, poor instruction-following, tone misses, brand-unsafe output, broken formatting, and lost context across turns.
• Write clear, reproducible evaluation reports including the prompt used, model and surface, expected vs. actual output, severity rating, and business impact.
• Assess the bundled AI subscription on value terms relative to standalone competitor offerings at comparable price points.
• Stress-test assistant features within social and commerce surfaces where business owners actually encounter them — not just standalone chat.

Skills

Small business owner

Daily AI usage

Instagram presence

Meta ads experience

US work eligibility

40 hours/week availability

Tools

Instagram

Facebook

Shopify

Square

QuickBooks

Klaviyo

Canva

CapCut

Later

Job description

SMB AI Power User — Competitive Evaluations | $40–50/hr | Remote (US Only)

Meridial is seeking a hands-on small business owner or operator to join a Competitive Evaluations team supporting a major consumer technology company. In this role, you'll use your real business operations as a test bed to evaluate an AI assistant subscription against leading standalone competitors — surfacing the gaps that actual paying subscribers will encounter.

About Meridial

Meridial places skilled, remote-first professionals into high-trust, high-precision operational roles for leading technology companies. Our teams operate as an embedded extension of our clients' product and operations organizations, holding the same quality bar and deadlines.

What You'll Do

• Run head-to-head prompts and multi-turn workflows across competing AI assistants using real small-business tasks — ad copy, content planning, customer messaging, supplier research, and light bookkeeping.
• Build and maintain a library of realistic SMB test cases spanning creative, organic content, customer communications, competitor research, pricing, scheduling, and more.
• Identify and document failure modes: wrong answers, unnecessary refusals, poor instruction-following, tone misses, brand-unsafe output, broken formatting, and lost context across turns.
• Write clear, reproducible evaluation reports including the prompt used, model and surface, expected vs. actual output, severity rating, and business impact.
• Assess the bundled AI subscription on value terms relative to standalone competitor offerings at comparable price points.
• Stress-test assistant features within social and commerce surfaces where business owners actually encounter them — not just standalone chat.

What We’re Looking For

• Owner or operator of a small or medium business (sole proprietor, founder, or day-to-day operator at a 1–200 person company).
• Daily, habitual use of generative AI tools for both business operations and marketing — occasional or experimental use is not a fit.
• Active organic presence on Instagram and Facebook, personally managed: posting, Stories, Reels, and community engagement.
• Hands‑on Meta paid advertising experience — has personally built, launched, and optimized campaigns with real budget.
• Based in the United States and authorized to work here.
• Availability of up to 40 hours per week to meet agreed deliverables and timelines.
• Exceptional written English — able to describe failures clearly enough for an engineer to reproduce without follow-up.
• Comfortable working independently against a rubric with a consistent weekly output cadence.

Nice to Have

• At least one active paid AI subscription (ChatGPT Plus/Pro, Claude Pro/Max, Gemini Advanced, or similar).
• Runs a side business or second venture alongside a primary role.
• Heavy personal and commercial Instagram use — fluent in Reels, Stories, trends, and creator tooling.
• Subscribes to two or more AI assistants simultaneously with an informed view on where each excels.
• Uses Aibeyond chat: automations, agents, API or no‑code integrations, custom GPTs or Projects.
• Prior experience with model evaluation, red teaming, data annotation, QA, or structured user research.
• Familiarity with SMB tools such as Shopify, Square, QuickBooks, Klaviyo, Canva, CapCut, or Later.

Compensation & Details

This is an independent contractor engagement paying $40–$50 per hour, with the exact rate determined based on experience, expertise, and location. Contractors must supply their own secure computer and high-speed internet. Company-sponsored benefits such as health insurance and PTO do not apply.