Experimentation & CRO Analyst

JARAL FASHIONS; Canada; On-site; CAD 90,000 - 130,000; Full time

Benefits offered by this job

Employee discount at Garage and Dynam:

Flexible vacation policy

Performance-driven bonuses

Retirement savings with employer match

Flexible insurance options

Job summary

Groupe Dynamite is seeking a data-driven Analytics Engineer to own our A/B testing and personalization program across web and app for GARAGE and DYNAMITE. You will define the experimentation roadmap and translate wins into revenue impact.

You will set up experiments in SiteSpect and Optimizely, coordinate with product, design, development and QA, and monitor results with rigorous statistics to inform roadmaps.

Qualifications

• 3 to 4 years hands-on A/B testing and CRO in ecommerce or digital product environment.
• Strong statistical foundation: p-values, confidence intervals, power, multiple testing.
• Experience with Optimizely.
• Ability to write clear Jira tickets with hypotheses, metrics, and acceptance criteria.
• Proven ability to own a roadmap and drive it forward independently.
• Strong communicator translating statistical concepts to business language.
• Experience with GA4 or similar analytics platforms for funnel analysis.

Responsibilities

• Own the end-to-end experimentation roadmap for web and app across both brands.
• Develop data-driven hypotheses from UX research and analytics and translate them into test briefs with clear metrics.
• Set up, QA, and launch experiments in SiteSpect and Optimizely with cross-functional coordination.
• Monitor live tests, analyze results with statistical rigour, and present findings through reports and decks.
• Lead stakeholder communication and monthly roadmap alignment meetings.
• Identify personalization opportunities and champion CRO/UX best practices as SME.

Skills

A/B testing

CRO experience

Optimizely

Jira

Statistics

Data analysis

GA4

Roadmap ownership

Communication

Education

Degree in Statistics

Engineering/CS background

Tools

SiteSpect

Optimizely

GA4

Jira

Job description

Groupe Dynamite is a leading fashion digital retailer with two brands at the heart of our success, GARAGE and DYNAMITE. With over 300 stores in Canada and the U.S., and more than 4,000 people, we have been making our mark on fashion since 1975.
Our core strengths are rooted in our team, our innovation, and our customers. We are proud to hire and retain aspirational leaders who are driven to achieve great things and recognized for their entrepreneurial spirit.

Job Summary:

Reporting to the Manager, E-comm Analytics and Experimentation, you will be the engine behind our A/B testing and personalization program across web and app for both the GARAGE and DYNAMITE brands. You will own the experimentation roadmap end to end—from generating creative ideas and insight‑led hypotheses to launching live tests, reading results with statistical rigour, and translating wins into measurable revenue impact.
You will be responsible for defining test strategy, setting up and running experiments in SiteSpect and Optimizely, coordinating across product, design, development, and QA teams, and maintaining a high standard of statistical discipline across all test conclusions. In this role, you will partner closely with the Web, App, Paid Media, CRM, E-comm, and Analytics teams across both brands.

Main Responsibilities:

• Own the end-to-end experimentation roadmap for web and app across both brands, prioritizing tests with a structured scoring framework aligned to quarterly conversion and revenue goals.
• Develop data-driven hypotheses from UX research, session recordings, and funnel analytics, and translate them into detailed test briefs (Jira tickets) with clear metrics, audience segments, and acceptance criteria.
• Set up, QA, and launch experiments in SiteSpect and Optimizely, coordinating with product, design, development, and QA through staging, UAT sign-off, and go-live.
• Monitor live tests, analyze results with statistical rigour (significance, confidence intervals, segment breakdowns), and present findings through results documentation, decks, and video walkthroughs.
• Lead stakeholder communication, including monthly roadmap alignment meetings, keeping teams proactively informed of test status, results, and next steps.
• Identify personalization opportunities across the funnel and champion CRO/UX best practices as the team's subject matter expert, recommending winning variants for permanent rollout.

Qualifications:

• Degree in a quantitative field such as Statistics, Mathematics, Computer Science, Data Science, or Engineering;
• 3 to 4 years of hands‑on A/B testing and CRO experience in an E-commerce or digital product environment, with a clear track record of driving measurable conversion impact;
• Strong statistical foundation: you understand p-values, confidence intervals, sample size calculation, statistical power, and the risks of peeking and multiple testing—and you apply this rigour consistently;
• Hands‑on experience with Optimizely;
• Experience writing Jira tickets that developers, QA, and stakeholders can easily execute—including clear hypothesis, defined metrics, precise acceptance criteria;
• Proven ability to own a roadmap and drive it forward independently without day‑to‑day direction;
• Strong communicator able to translate statistical concepts into clear business language for non‑technical audiences;
• Experience with GA4 or equivalent analytics platforms for funnel analysis and test monitoring.

Assets:

• Familiarity with mobile app testing environments and the constraints of in‑app experimentation;
• Experience with personalization tools such as Dynamic Yield, Nosto, or Klaviyo segmentation;
• Ability to create Figma mockups or wireframes to accompany test briefs.

At GDI, you will be part of a growing organization that understands the importance of investing in people and offers you:

• A comprehensive compensation package that includes performance-driven bonuses;
• A group retirement savings program with employer matching;
• Flexible group insurance with personalized coverage that meets your needs;
• An employee discount at Garage and Dynamite;
• A flexible vacation policy;
• And more!

GDI has been repeatedly voted one of Montréal’s Top Employers and one of Canada’s Top Employers for Young People.

Our promise…

No day will be like the last—we aim to be better today than we were yesterday. We are committed to employment equity.

Candidates that are retained will be called for an interview.
#NR-LI1