CRO Analyst

Blue Stout; United States; Remote; USD 55,000 - 124,000; Part time

Job summary

Blue Stout is a fully remote CRO agency seeking a proactive CRO Analyst to own end-to-end A/B test setup and analysis, collaborating with our senior team and clients. You will set up tests on Convert.com and VWO, analyze results with Bayesian methods, and translate insights into client recommendations, working with designers and developers on Shopify template implementations.

This freelancer role requires availability during US Pacific Time business hours and active participation in client calls

Qualifications

• 2+ years of CRO experience in a performance-focused environment.
• Hands-on end-to-end A/B testing setup and analysis.
• Proficiency with Convert.com or similar platform (VWO, Optimizely).
• Strong GA4 event tracking, funnel analysis, and data interpretation.
• Solid JavaScript and DOM manipulation skills.
• Working knowledge of HTML/CSS for test setup.
• Understanding of Shopify architecture—sections, templates, and theme structure.
• Available during US Pacific Time business hours.

Responsibilities

• Set up, manage, and monitor A/B tests using Convert.com and VWO.
• Analyze test results using Bayesian methods and forecast revenue lift.
• Communicate test findings and insights to clients via weekly progress updates.
• Collaborate with designers and developers to implement winning variations.
• Join client calls twice monthly to discuss strategy and provide recommendations.
• Participate in internal team syncs at least twice a week.
• Ensure test setup aligns with Shopify templates and targeting.

Skills

CRO experience

A/B tests setup

GA4

JavaScript

HTML/CSS

Shopify architecture

US Pacific Time availability

Tools

Convert.com

VWO

Optimizely

Looker Studio

Hotjar

Microsoft Clarity

Job description

About Blue Stout

We’re a fully remote CRO agency that partners with fast-growing DTC brands on Shopify — typically $5M–$100M in annual revenue. We help them increase conversion rates and revenue per visitor through strategic site optimizations and data-driven A/B testing. If you love identifying what makes users click and want to work with exciting, recognizable brands, this is your opportunity.

The Role

We’re looking for a sharp, proactive CRO Analyst to join our team as a freelancer. You’ll own A/B test setup and analysis end-to-end, work directly alongside our senior CRO team, and communicate findings to clients. This role sits at the intersection of data, UX intuition, and clean technical execution.

What You’ll Do

• Set up, manage, and monitor A/B tests using Convert.com and VWO
• Analyze test results using the Bayesian method and forecast revenue lift
• Communicate test findings and insights to clients via weekly progress updates
• Collaborate with designers and developers to implement winning variations
• Join 2 monthly calls per client to discuss strategy and provide recommendations
• Participate in internal team syncs at least twice a week
• Ensure test setup aligns with Shopify templates and targeting is accurate

Requirements

What We’re Looking For

• 2+ years of CRO experience in a performance-focused environment
• Hands-on experience setting up A/B tests end-to-end, from hypothesis to analysis
• Proficiency in Convert.com or a comparable testing platform (VWO, Optimizely)
• Strong GA4 skills — event tracking, funnel analysis, and data interpretation
• Solid JavaScript skills — able to write clean, dynamic DOM manipulation code without fixed delays or fragile class-based targeting
• Working knowledge of HTML/CSS for test setup and variant implementation
• Understanding of Shopify architecture — sections, templates, and theme structure
• Available during US Pacific Time business hours

Nice to Have:

• Experience with Google Looker Studio for reporting
• Familiarity with heuristic evaluation frameworks (Nielsen’s 10, LIFT model, etc.)
• Experience with session recording and heatmap tools (Hotjar, Microsoft Clarity)
• Prior agency experience working across multiple client accounts simultaneously