Experimentation & CRO Analyst

Groupe Dynamite; Mount Royal; On-site; CAD 90,000 - 125,000; Full time

Benefits offered by this job

Performance-driven bonuses

Retirement savings with employer match

Flexible vacation policy

Employee discount at Garage and Dynamé

Job summary

Groupe Dynamite is seeking a senior E-comm Analytics & Experimentation specialist to own the experimentation roadmap across GARAGE and DYNAMITE brands. You will drive test ideas from hypothesis to live deployments and quantify revenue impact with rigorous statistical analysis.

You will collaborate with Web, App, Paid Media, CRM, E-comm, and Analytics teams to ensure tests are prioritized, well-documented, and aligned with quarterly goals. Montreal-based role with strong cross-functional exposure.

Qualifications

• Degree in a quantitative field such as Statistics, Mathematics, Computer Science, Data Science, or Engineering.
• 3–4 years of hands-on A/B testing and CRO experience in an e-commerce or digital product environment.
• Strong statistical foundation: p-values, confidence intervals, sample size, power, and multiple testing risks.
• Hands-on experience with Optimizely.
• Experience writing Jira tickets with clear hypotheses, metrics, and acceptance criteria.
• Proven ability to own a roadmap and drive it forward independently.
• Strong communicator able to translate statistical concepts for non-technical audiences.
• Experience with GA4 or equivalent analytics platforms for funnel analysis and test monitoring.

Responsibilities

• Own the end-to-end experimentation roadmap for web and app across both brands, prioritizing tests with a structured scoring framework aligned to quarterly conversion and revenue goals.
• Develop data-driven hypotheses from UX research, session recordings, and funnel analytics, and translate them into detailed test briefs with clear metrics, audience segments, and acceptance criteria.
• Set up, QA, and launch experiments in SiteSpect and Optimizely, coordinating with product, design, development, and QA through staging, UAT sign-off, and go-live.
• Monitor live tests, analyze results with statistical rigour, and present findings through results documentation, decks, and video walkthroughs.
• Lead stakeholder communication, including monthly roadmap alignment meetings, keeping teams informed of test status, results, and next steps.
• Identify personalization opportunities across the funnel and champion CRO/UX best practices as the team’s subject matter expert.

Skills

A/B testing

CRO

Statistical analysis

Roadmap ownership

Communication

Education

Quantitative field degree (Statistics/Math/CS/Data Science/Engineering)

Tools

Optimizely

SiteSpect

Jira

GA4

Dynamic Yield / Personalization tools

Job description

Overview

Groupe Dynamite is a leading fashion digital retailer with two brands at the heart of our success, GARAGE and DYNAMITE. With over 300 stores in Canada and the U.S., and more than 4,000 people, we have been making our mark on fashion since 1975.
Our core strengths are rooted in our team, our innovation, and our customers. We are proud to hire and retain aspirational leaders who are driven to achieve great things and recognized for their entrepreneurial spirit.

Job Summary:

Reporting to the Manager, E-comm Analytics and Experimentation, you will be the engine behind our A/B testing and personalization program across web and app for both the GARAGE and DYNAMITE brands. You will own the experimentation roadmap end to end—from generating creative ideas and insight-led hypotheses to launching live tests, reading results with statistical rigour, and translating wins into measurable revenue impact.
You will be responsible for defining test strategy, setting up and running experiments in SiteSpect and Optimizely, coordinating across product, design, development, and QA teams, and maintaining a high standard of statistical discipline across all test conclusions. In this role, you will partner closely with the Web, App, Paid Media, CRM, E-comm, and Analytics teams across both brands.

Main Responsibilities:

• Own the end-to-end experimentation roadmap for web and app across both brands, prioritizing tests with a structured scoring framework aligned to quarterly conversion and revenue goals.
• Develop data-driven hypotheses from UX research, session recordings, and funnel analytics, and translate them into detailed test briefs (Jira tickets) with clear metrics, audience segments, and acceptance criteria.
• Set up, QA, and launch experiments in SiteSpect and Optimizely, coordinating with product, design, development, and QA through staging, UAT sign-off, and go-live.
• Monitor live tests, analyze results with statistical rigour (significance, confidence intervals, segment breakdowns), and present findings through results documentation, decks, and video walkthroughs.
• Lead stakeholder communication, including monthly roadmap alignment meetings, keeping teams proactively informed of test status, results, and next steps.
• Identify personalization opportunities across the funnel and champion CRO/UX best practices as the team's subject matter expert, recommending winning variants for permanent rollout.

Qualifications:

• Degree in a quantitative field such as Statistics, Mathematics, Computer Science, Data Science, or Engineering;
• 3 to 4 years of hands-on A/B testing and CRO experience in an E-commerce or digital product environment, with a clear track record of driving measurable conversion impact;
• Strong statistical foundation: you understand p-values, confidence intervals, sample size calculation, statistical power, and the risks of peeking and multiple testing—and you apply this rigour consistently;
• Hands-on experience with Optimizely;
• Experience writing Jira tickets that developers, QA, and stakeholders can easily execute—including clear hypothesis, defined metrics, precise acceptance criteria;
• Proven ability to own a roadmap and drive it forward independently without day-to-day direction;
• Strong communicator able to translate statistical concepts into clear business language for non-technical audiences;
• Experience with GA4 or equivalent analytics platforms for funnel analysis and test monitoring.

Assets:

• Familiarity with mobile app testing environments and the constraints of in-app experimentation;
• Experience with personalization tools such as Dynamic Yield, Nosto, or Klaviyo segmentation;
• Ability to create Figma mockups or wireframes to accompany test briefs.

At GDI, you will be part of a growing organization that understands the importance of investing in people and offers you:

• A comprehensive compensation package that includes performance-driven bonuses;
• A group retirement savings program with employer matching;
• Flexible group insurance with personalized coverage that meets your needs;
• An employee discount at Garage and Dynamite;
• Exclusive private sample sales;
• A flexible vacation policy;
• And more!

GDI has been repeatedly voted one of Montréal’s Top Employers and one of Canada’s Top Employers for Young People.

Our promise…

No day will be like the last—we aim to be better today than we were yesterday. We are committed to employment equity.

Candidates that are retained will be called for an interview.