Experimentation & CRO Analyst

Groupe Dynamite; Canada; On-site; CAD 85,000 - 115,000; Full time

Benefits offered by this job

Performance-driven bonuses

Group retirement savings with employer

Flexible group insurance

Employee discount at Garage and Dynam"

Exclusive private sample sales

Flexible vacation policy

Job summary

Groupe Dynamite is seeking an analytics-driven CRO specialist to lead the end-to-end experimentation program for GARAGE and DYNAMITE. Reporting to the Manager, E-comm Analytics and Experimentation, you will own the test roadmap from hypothesis to live results.

You will set up tests in Optimizely and SiteSpect, analyze outcomes with statistical rigour, and translate insights into revenue impact. Strong collaboration with product, design, development, and QA is essential.

Qualifications

• Degree in a quantitative field such as Statistics, Mathematics, Computer Science, Data Science, or Engineering.
• 3–4 years of hands-on A/B testing and CRO experience in an e-commerce or digital product environment.
• Strong statistical foundation: p-values, confidence intervals, sample size calculation, statistical power, and the risks of peeking and multiple testing.
• Hands-on experience with Optimizely.
• Experience writing Jira tickets with hypotheses, defined metrics and acceptance criteria.
• Proven ability to own a roadmap and drive it forward independently.
• Strong communicator able to translate statistical concepts into clear business language.
• Experience with GA4 or equivalent analytics platforms.

Responsibilities

• Own end-to-end experimentation roadmap for web and app across both brands.
• Develop data-driven hypotheses from UX research, session recordings, and funnel analytics, and translate them into detailed test briefs with metrics, audiences, and acceptance criteria.
• Set up, QA, and launch experiments in SiteSpect and Optimizely, coordinating with product, design, development, and QA through staging, UAT sign-off, and go-live.
• Monitor live tests, analyze results with statistical rigour, and present findings through results documentation, decks, and video walkthroughs.
• Lead stakeholder communication, including monthly roadmap alignment meetings, keeping teams informed of test status, results, and next steps.
• Identify personalization opportunities across the funnel and champion CRO/UX best practices as the team's SME.

Skills

A/B testing

CRO experience

Statistical rigour

Optimizely

Jira tickets

Roadmap ownership

Business communication

GA4

Education

Degree in Statistics / Mathematics / CS / Data Science / Engineering

Tools

Optimizely

SiteSpect

Job description

Overview

Groupe Dynamite is a leading fashion digital retailer with two brands at the heart of our success, GARAGE and DYNAMITE. With over 300 stores in Canada and the U.S., and more than 4,000 people, we have been making our mark on fashion since 1975.
Our core strengths are rooted in our team, our innovation, and our customers. We are proud to hire and retain aspirational leaders who are driven to achieve great things and recognized for their entrepreneurial spirit.

Job Summary:

Reporting to the Manager, E-comm Analytics and Experimentation, you will be the engine behind our A/B testing and personalization program across web and app for both the GARAGE and DYNAMITE brands. You will own the experimentation roadmap end to end—from generating creative ideas and insight-led hypotheses to launching live tests, reading results with statistical rigour, and translating wins into measurable revenue impact.
You will be responsible for defining test strategy, setting up and running experiments in SiteSpect and Optimizely, coordinating across product, design, development, and QA teams, and maintaining a high standard of statistical discipline across all test conclusions. In this role, you will partner closely with the Web, App, Paid Media, CRM, E-comm, and Analytics teams across both brands.

Main Responsibilities:

• Own the end-to-end experimentation roadmap for web and app across both brands, prioritizing tests with a structured scoring framework aligned to quarterly conversion and revenue goals.
• Develop data-driven hypotheses from UX research, session recordings, and funnel analytics, and translate them into detailed test briefs (Jira tickets) with clear metrics, audience segments, and acceptance criteria.
• Set up, QA, and launch experiments in SiteSpect and Optimizely, coordinating with product, design, development, and QA through staging, UAT sign-off, and go-live.
• Monitor live tests, analyze results with statistical rigour (significance, confidence intervals, segment breakdowns), and present findings through results documentation, decks, and video walkthroughs.
• Lead stakeholder communication, including monthly roadmap alignment meetings, keeping teams proactively informed of test status, results, and next steps.
• Identify personalization opportunities across the funnel and champion CRO/UX best practices as the team's subject matter expert, recommending winning variants for permanent rollout.

Qualifications:

• Degree in a quantitative field such as Statistics, Mathematics, Computer Science, Data Science, or Engineering;
• 3 to 4 years of hands-on A/B testing and CRO experience in an E-commerce or digital product environment, with a clear track record of driving measurable conversion impact;
• Strong statistical foundation: you understand p-values, confidence intervals, sample size calculation, statistical power, and the risks of peeking and multiple testing—and you apply this rigour consistently;
• Hands-on experience with Optimizely;
• Experience writing Jira tickets that developers, QA, and stakeholders can easily execute—including clear hypothesis, defined metrics, precise acceptance criteria;
• Proven ability to own a roadmap and drive it forward independently without day-to-day direction;
• Strong communicator able to translate statistical concepts into clear business language for non-technical audiences;
• Experience with GA4 or equivalent analytics platforms for funnel analysis and test monitoring.

Assets:

• Familiarity with mobile app testing environments and the constraints of in-app experimentation;
• Experience with personalization tools such as Dynamic Yield, Nosto, or Klaviyo segmentation;
• Ability to create Figma mockups or wireframes to accompany test briefs.

At GDI, you will be part of a growing organization that understands the importance of investing in people and offers you:

• A comprehensive compensation package that includes performance-driven bonuses;
• A group retirement savings program with employer matching;
• Flexible group insurance with personalized coverage that meets your needs;
• An employee discount at Garage and Dynamite;
• Exclusive private sample sales;
• A flexible vacation policy;
• And more!

GDI has been repeatedly voted one of Montréal’s Top Employers and one of Canada’s Top Employers for Young People.

Our promise…

No day will be like the last—we aim to be better today than we were yesterday. We are committed to employment equity.

Candidates that are retained will be called for an interview.