Conversion Rate Optimization Specialist / Sr. CRO Specialist

Skill; United States; On-site; USD 80,000 - 125,000; Full time

Job summary

Aquent, collaborating with a leading media company, seeks a hands-on Experimentation Specialist to own the day-to-day testing program across paid media, lifecycle, landing pages, onboarding flows, and creative assets. Lead end-to-end experiments and translate insights into growth actions that move business metrics.

The Senior level offers broader autonomy, higher expectations for statistical rigor, cross-channel synthesis, and mentorship.

Qualifications

• Hands-on experience running A/B or multivariate tests in a marketing or growth context.
• Fluency with at least one industry-standard experimentation platform to set up and QA tests.
• Strong working understanding of experimental design principles, including control/treatment setup, sample sizing, statistical significance.
• Robust analytical fluency with analytics dashboards and data reads.
• Ability to audit an existing testing program quickly and ship a better-instrumented experiment.
• Exceptional written and verbal communication skills.
• Proficiency with AI tools for drafting test plans and analyzing results.
• Discipline to ship on time with thorough QA and naming conventions.

Responsibilities

• Develop and maintain a dynamic testing roadmap and hypothesis backlog across paid media, email/lifecycle, landing pages, onboarding flows, monetization strategies, and creative assets.
• Provide weekly, up-to-date views of ongoing tests, learnings, and upcoming experiments to the Director and channel owners.
• Design and launch robust A/B, multivariate, holdout, and geo-based experiments with proper controls and metrics.
• Partner with Data & Analytics and Engineering to ensure precise tracking, instrumentation, and attribution for launches.
• Analyze test results and deliver clear, actionable recommendations on shipping, iteration, or kill and plan next experiments.
• Translate winning results into concrete, channel-specific actions with cross-functional teams.
• Present complex findings to stakeholders in clear, non-technical language.
• Foster cross-channel synthesis and a shared testing culture across Paid Media, Lifecycle/CRM, SEO, and Content teams.
• Maintain a simple, searchable repository of test results to ensure learnings compound over time.

Skills

A/B testing

Multivariate tests

Experimental design

Data analytics

AI tools

Communication skills

Tools

Experimentation platforms

Job description

Overview

Placement Type:

Permanent

Salary:

$80,000-125,000 Salary

Start Date:

Sep 21, 2026

Aquent is partnering with a leading media company at the forefront of its industry, renowned for operating one of the world's largest premium platforms. This is a pivotal moment for the organization as it embarks on a significant brand evolution. We are seeking a visionary and hands-on Experimentation Specialist to drive the core of our growth strategy. In this role, you won't just run tests; you'll be instrumental in shaping the future of user experience, directly impacting key business metrics and influencing strategic decisions across the entire organization. Your expertise will unlock new insights, optimize user journeys, and accelerate our mission to deliver unparalleled value to our global audience.

Are you a seasoned experimentation professional ready to make a monumental impact? We are looking for a dynamic individual to take ownership of our day-to-day testing program. This is an incredible opportunity to build, execute, and refine a robust experimentation framework across diverse channels, including paid media, email/lifecycle, landing pages, onboarding flows, and creative assets. You will be the architect of insights, translating complex data into clear, actionable recommendations that directly fuel our growth initiatives and brand transformation.

This role is designed for a hands-on operator who thrives in a fast-paced environment. From day one, you'll dive into our existing testing infrastructure, swiftly auditing current experiments, identifying areas for improvement, and launching more rigorously instrumented tests. You'll be a central figure in our growth ecosystem, reporting to the Director of Growth & Lifecycle Marketing and collaborating closely with Paid Media, Lifecycle/CRM, SEO, Creative, Data & Analytics, Product, and Brand teams. Your work will not only optimize performance but also foster a data-driven culture of continuous learning and innovation.

This position is open at two levels, reflecting varying depths of experience and scope of responsibility. Whether you're a rising talent or a seasoned expert, your placement will be determined by your proven track record in testing platforms, analytical prowess, and demonstrated ownership of end-to-end experiments. The Senior level offers broader autonomy, higher expectations for statistical rigor, cross-channel synthesis, and mentorship opportunities.

If your daily passion involves designing, shipping, and interpreting experiments that move business metrics, we encourage you to apply. We value impact over titles, and your expertise in conversion rate optimization, growth marketing, or experimentation will be highly valued.

What You'll Own and Drive

• Testing Roadmap, Prioritization & Program Management: Develop and maintain a dynamic testing roadmap and hypothesis backlog spanning paid media, email/lifecycle, landing pages, onboarding flows, monetization strategies, and creative assets. You will prioritize experiments using a clear framework, ensuring the highest-impact, highest-confidence initiatives run first.
• Transparent Communication & Velocity: Provide weekly, up-to-date views of ongoing tests, key learnings, and upcoming experiments to the Director and channel owners. You will establish and maintain optimal testing velocity, ensuring a steady stream of concurrent, non-interfering experiments.
• Expert Test Design & Execution: Design and launch robust A/B, multivariate, and, where appropriate, holdout and geo-based experiments. This includes meticulous attention to proper control groups, adequate sample sizes, and clearly pre-defined success metrics. You will personally set up and QA tests within various industry-standard experimentation platforms.
• Data Integrity & Metric Definition: Partner closely with Data & Analytics and Engineering teams to ensure precise tracking, event instrumentation, and attribution prior to every launch. You will define primary, secondary, and crucial guardrail metrics for each test, articulated in plain, business-relevant terms.
• In-depth Analysis, Insights & Recommendations: Conduct thorough analysis of test results utilizing analytics platforms, experimentation dashboards, and data warehouse cuts. You will skillfully distinguish between statistical significance and business significance, holding a high bar for both. For every completed test, you will deliver a structured recommendation-whether to ship, iterate, or kill-complete with clear rationale and the next experiment queued for deployment.
• Actionable Implementation: Translate winning results into concrete, channel-specific actions: refining campaign strategies for Paid Media, optimizing flow logic for Lifecycle/CRM, collaborating with Product for landing page and onboarding updates, and providing creative direction to the Creative team.
• Stakeholder Communication: Present complex findings to cross-functional stakeholders through clear, non-technical narratives that effectively connect test outcomes to broader business objectives.
• Cross-Channel Synthesis & Testing Culture: Connect the dots across all channels, surfacing patterns from paid tests that inform lifecycle messaging and vice versa. You will build shared creative and messaging frameworks derived from comprehensive testing insights.
• Collaborative Alignment: Partner with Paid Media, Lifecycle/CRM, SEO, and Content teams to align on learnings, coordinate overlapping tests, and prevent duplicate or conflicting work.
• Knowledge Management & Advocacy: Maintain a simple, searchable repository of test results to ensure that learnings compound over time, rather than being re-learned. You will champion a robust test-and-learn culture through regular readouts, workshops, and the establishment of clear testing standards.

Must-Have Qualifications

• Hands-on experience running A/B or multivariate tests in a marketing or growth context (paid, email, landing page, onboarding, or monetization strategies), with a preference for experience at a consumer subscription, marketplace, mobile-first, or social platform.
• In-the-tool fluency with at least one industry-standard experimentation or A/B testing platform, with the ability to set up and QA tests independently.
• A strong working understanding of experimental design principles, including control/treatment setup, sample sizing, statistical significance, and common validity threats (e.g., novelty, seasonality, SRM, interaction effects). You instinctively know when to call a test and when to let it run.
• Robust analytical fluency, comfortable navigating analytics platforms, experimentation dashboards, and spreadsheet tools. You can pull your own data reads and critically evaluate analyses provided by data teams.
• A proven ability to quickly audit an existing testing program, identify design flaws, and ship a better-instrumented experiment within your first week.
• Exceptional written and verbal communication skills, capable of crafting crisp test briefs and presenting nuanced results to both technical and non-technical audiences with confidence.
• Proficiency with AI tools in your daily workflow for tasks such as drafting test plans, generating variant copy and creative, analyzing results, and automating manual processes.
• Demonstrated operator's discipline: consistently shipping on time, executing with tight QA, maintaining clean naming conventions, and thoroughly documenting every result.

Specific Experience by Level:

For the Experimentation Specialist:

• 2 to 4 years of hands-on experience in conversion rate optimization, growth marketing, experimentation, or analytical marketing.
• A practical track record of designing and shipping tests across at least one of the following: paid media, email/lifecycle, landing pages, or onboarding, with measurable results you can articulate.
• Ownership of end-to-end execution across these channels, contributing to prioritization and testing-cadence discussions with the Director.

For the Senior Experimentation Specialist:

• 5 to 8+ years of hands-on experience in conversion rate optimization, experimentation, or growth marketing, ideally including time at a consumer subscription business, direct-to-consumer brand, or mobile-first product.
• A proven track record of running experiments across two or more channels (e.g., paid, lifecycle, landing pages, onboarding, monetization strategies, or in-product marketing), demonstrating measurable business impact.
• Comfortable with SQL or direct data warehouse access to build audiences, validate segments, and conduct independent analysis, without relying solely on data teams for performance insights.
• Ownership of both execution and strategic direction, setting testing standards, driving the roadmap, and confidently defending prioritization decisions to leadership.
• A natural mentor, comfortable reviewing test designs, tracking hygiene, and results interpretation as the experimentation function scales.

Nice-to-Have Qualifications

• Experience within a consumer subscription, marketplace, or social platform environment where activation, retention, and customer lifetime value are primary growth levers.
• Familiarity with advanced statistical methods such as Bayesian methods, multi-armed bandit approaches, or adaptive experimentation, with a clear understanding of their appropriate application.
• A background in behavioral economics or consumer psychology, providing deeper insights into user behavior for sharper hypothesis generation.
• Experience contributing to a company-wide experimentation program, including governance, tooling, standards development, or team training initiatives.
• Experience designing experiments specifically around AI-driven personalization or recommendation systems.
• A Bachelor's degree in Marketing, Business, Statistics, Economics, Mathematics, Computer Science, or a related analytical field, or an equivalent track record of shipping rigorous tests.

Aquent is an equal-opportunity employer. We evaluate qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, and other legally protected characteristics. We're about creating an inclusive environment-one where different backgrounds, experiences, and perspectives are valued, and everyone can contribute, grow their careers, and thrive.