CRO Analyst

BlueStout.com - Ecommerce Experts; Town of Poland (NY); On-site; USD 70,000 - 90,000; Full time

Job summary

A leading CRO agency is looking for a remote CRO Analyst to optimize conversion rates for DTC brands. You will set up and analyze A/B tests, communicate insights to clients, and collaborate closely with a senior team. The ideal candidate has over 2 years of experience, strong GA4 skills, and proficiency with testing platforms like Convert.com. This role requires good communication and a solid understanding of Shopify.

Qualifications

• Over 2 years of CRO experience in a performance-focused environment.
• Experience in setting up A/B tests from hypothesis to analysis.
• Proficiency in testing platforms like Convert.com or VWO.

Responsibilities

• Set up, manage, and monitor A/B tests using Convert.com and VWO.
• Analyze test results using the Bayesian method and forecast revenue lift.
• Communicate test findings and insights to clients.

Skills

CRO experience

A/B testing proficiency

GA4 skills

JavaScript skills

HTML/CSS knowledge

Tools

Convert.com

VWO

Google Analytics 4

Shopify

Job description

About Blue Stout

We're a fully remote CRO agency that partners with fast-growing DTC brands on Shopify — typically $5M-$100M in annual revenue. We help them increase conversion rates and revenue per visitor through strategic site optimizations and data-driven A/B testing. If you love identifying what makes users click and want to work with exciting, recognizable brands, this is your opportunity.

The Role

We're looking for a sharp, proactive CRO Analyst to join our team as a freelancer. You'll own A/B test setup and analysis end-to-end, work directly alongside our senior CRO team, and communicate findings to clients. This role sits at the intersection of data, UX intuition, and clean technical execution.

What You'll Do

• Set up, manage, and monitor A/B tests using Convert.com and VWO
• Analyze test results using the Bayesian method and forecast revenue lift
• Communicate test findings and insights to clients via weekly progress updates
• Collaborate with designers and developers to implement winning variations
• Join 2 monthly calls per client to discuss strategy and provide recommendations
• Participate in internal team syncs at least twice a week
• Ensure test setup aligns with Shopify templates and targeting is accurate

How To Apply

Start your application with 'CRO Superhero' so we know you're paying attention 😉

Then include:

• 2-3 examples of CRO projects you've led or contributed to (with results where possible)
• The platforms and tools you've worked with (Convert, VWO, GA4, Shopify, etc.)
• A short note on why you're excited about working with fast-growing DTC brands

Requirements

What We're Looking For

Required:

• 2+ years of CRO experience in a performance-focused environment
• Hands-on experience setting up A/B tests end-to-end, from hypothesis to analysis
• Proficiency in Convert.com or a comparable testing platform (VWO, Optimizely)
• Strong GA4 skills — event tracking, funnel analysis, and data interpretation
• Solid JavaScript skills — able to write clean, dynamic DOM manipulation code without fixed delays or fragile class-based targeting
• Working knowledge of HTML/CSS for test setup and variant implementation
• Understanding of Shopify architecture — sections, templates, and theme structure
• Available during US Pacific Time business hours

Nice to Have:

• Experience with Google Looker Studio for reporting
• Familiarity with heuristic evaluation frameworks (Nielsen's 10, LIFT model, etc.)
• Experience with session recording and heatmap tools (Hotjar, Microsoft Clarity)
• Prior agency experience working across multiple client accounts simultaneously