Strategy & Analytics Experimentation Director

United States Digital Space LLC; New York (NY); Hybrid; USD 276,000 - 380,000; Full time

Job summary

the company is seeking an Experimentation Director to raise the rigor of experimentation while maintaining velocity. You will own our experimentation methodology, build an OS for experiments, and partner with Strategy & Analytics, Engineering, Data Science, and Product on complex tests.

This role reports to the Head of Strategy & Analytics and requires proven experience designing and reviewing hundreds of experiments, plus strong statistics and cross-team communication.

Qualifications

• 10+ years in experimentation, data science, or closely related analytical role.
• Designed, reviewed, and analyzed hundreds of experiments on a central platform.
• Strong statistical expertise: power and sample sizing, sequential testing, multiple comparisons.
• Proficient in SQL and reading results skeptically.

Responsibilities

• Own experimentation methodology and principles to ensure accuracy and rigor.
• Build and maintain the company's experimentation OS and review processes.
• Adapt our experiment methodology as velocity increases with AI.
• Partner with S&A, Engineering, Data Science, and Product to design and measure experiments.
• Act as the expert on causal inference for diff-in-diff, synthetic control, etc.
• Perform ad hoc experiment review and analysis to explain anomalous results.

Skills

Experimentation

Statistical expertise

SQL

Cross-functional influence

Communication

Job description

About the company

the company is a technology wholesale platform built on the belief that the future is local. Independent retailers around the globe collectively represent a multi-hundred-billion-dollar wholesale market that has historically been fragmented and offline. At the company, we're using the power of tech, data, and machine learning to connect this thriving community of entrepreneurs across the globe. Picture your favorite boutique in town — we help them discover the best products from around the world to sell in their stores. With the right tools and insights, we believe that we can level the playing field so businesses can grow and local communities can thrive.

We’re looking for smart, resourceful and passionate people to join us as we power the shop local movement. If you believe in community, come join ours.

About this role

We are looking for an Experimentation Director to be the company's authority on experimentation. Your mission is to increase the rigor of experimentation at the company without sacrificing velocity. You'll own our experimentation methodology and principles, and raise the quality of how experiments are designed, run, read, and acted on across every team.

This is a high-visibility, high-impact individual contributor role reporting into the Head of Strategy & Analytics. You will be the default experimentation partner and reviewer for our most high-stakes and complex experiments, and a key partner to Strategy & Analytics, Engineering, Data Science, and Product on everything experimentation-related.

What you’ll do

• Own experimentation methodology and principles to ensure accuracy and rigor across all experiments.

• Build and maintain the company's experimentation OS, including experiment review processes and cross-company experiment tracking and visibility.

• Adapt our experiment methodology and operating system as velocity of experimentation increases substantially with AI.

• Partner with S&A, Engineering, Data Science, and Product to design and measure experiments and act as the default design partner and reviewer for high-stakes or methodologically complex experiments.

• Act as the company's expert on causal inference in cases where we cannot run a true experiment, including helping other teams design and execute diff-in-diff, synthetic control, and other causal analyses.

• Perform ad hoc experiment review and analysis to understand anomalous results and drive each to a trusted conclusion.

• Partner with the Analytics Platform team to help set their roadmap for the experiment platform and data model.

Qualifications

• 10+ years of relevant experience in experimentation, data science, or a closely related analytical role.

• You have extensive experimentation experience. You have designed, reviewed, and analyzed hundreds of experiments — ideally on a central experimentation or platform team at a company with a mature testing culture.

• You have deep statistical expertise. You have a strong command of the methods that make experiments trustworthy: power and sample sizing, sequential testing, variance reduction, multiple comparisons, and interference between units. When a clean A/B test isn't possible, you can design and run alternatives.

• You’re analytically rigorous. You are comfortable using SQL to work through large datasets, can QC work when needed, and can read results skeptically - catching subtle problems others miss.

• You have strong cross-functional influence. You can raise the bar on how teams across Engineering, Product, Data Science, and Strategy & Analytics design, run, and interpret experiments.

• You understand data and experimentation platforms — how assignment infrastructure, metric pipelines, and data models work, and how methodological choices interact with them.

• You are a strong communicator. You make our experiments and their impact legible to others at the company through strong spoken and written communication.

• You are practical. You balance rigor with speed and optimize for impact.

Salary Range

San Francisco or New York City: the pay range for this role is $276,000 - $379,500 per year.

This role will also be eligible for equity and benefits. Actual base pay will be determined based on permissible factors such as transferable skills, work experience, market demands, and primary work location. The base pay range provided is subject to change and may be modified in the future.

Hybrid the company employees currently go into the office 3 days per week on Tuesdays, Thursdays, and a third flex day of their choosing (Monday, Wednesday, or Friday). Additionally, hybrid in-office roles will have the flexibility to work remotely up to 4 weeks per year. Specific Workplace and Information Technology positions may require onsite attendance 5 days per week as will be indicated in the job posting.

Why you’ll love working at the company

• Move fast: You'll own meaningful problems that serve customers around the globe with the agency to move fast and see your results clearly.

• Equipped to scale: We invest in what matters, including the latest enterprise AI tools, to help you work smarter and get more out of every day.

• Best in class: Our team is full of sharp, kind, and generous colleagues who care about their craft and about helping you grow in yours.

• Real rewards. Competitive pay, equity, and comprehensive benefits designed to support your life inside and outside of work.

• Belonging: We're intentional about building an environment where every the company employee has equal access to opportunities, growth, and success.

the company was founded in 2017 by a team of early product and engineering leads from Square. We’re backed by some of the top investors in retail and tech including: Y Combinator, Lightspeed Venture Partners, Forerunner Ventures, Khosla Ventures, Sequoia Capital, Founders Fund, and DST Global. We have headquarters in San Francisco and Kitchener-Waterloo, and a global employee presence across offices in Toronto, London, and New York. To learn more about the company and our customers, you can read more on our blog.

the company provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, sexual orientation, gender identity or gender expression.

the company is committed to providing access, equal opportunity and reasonable accommodation for individuals with disabilities in employment, its services, programs, and activities.

Accommodations are available throughout the recruitment process and applicants with a disability may request to be accommodated throughout the recruitment process.

We will work with all applicants to accommodate their individual accessibility needs.

To request reasonable accommodation, please fill out our Accommodation Request Form (https://bit.ly/the company-form)

Privacy

For information about the type of personal data the company collects from applicants, as well as your choices regarding the data collected about you, please visit the company’s