Mid-term CRO & Experimentation Specialist →

Wise Pirates; Portugal; Hybrid; EUR 32,000 - 52,000; Full time

Job summary

Wise Pirates seeks restless people, focused on evolving to learn, on producing meaningful impacts, and on working in a highly collaborative way, in a Digital and Tech context. We want to meet people who are digital natives and full of good energy and a good attitude.

CRO is where opinions go to be tested. The job is to find where a funnel loses people, form a hypothesis about why, and design an experiment that can actually answer it.

Qualifications

• CRO experience with experimentation and digital analytics (2–4 years).
• Understanding of sample size, significance, power and multiple comparisons.
• Familiarity with GA4, heatmaps, session replay and funnel reports.
• End-to-end A/B testing experience in any tool.
• Basic HTML/CSS/JS to read and brief variants clearly.
• Ability to connect conversion rate to revenue and client growth.
• Fluency in Portuguese and strong English.
• Interest in applying AI tools responsibly in research and testing.

Responsibilities

• Perform funnel analyses, heatmaps, and session replay to identify frictions.
• Form hypotheses about drivers of drop-off and prioritise actions.
• Rank backlog using ICE/PIE or PIRATE framework and defend order.
• Design A/B, A/B/n, multivariate and split-URL tests with clear metrics.
• Brief variants, verify test setup, and ensure results accuracy.
• Interpret results with statistics, noting significance and effects.
• Extend work beyond landing pages into full funnel and CRM.
• Help clients build a testing habit with documentation and cadence.
• Report outcomes in business terms, including both wins and losses.

Skills

CRO & analytics

Statistical literacy

Google Analytics 4

A/B testing

HTML/CSS basics

Commercial reasoning

AI literacy

Portuguese & English

Job description

Wise Pirates seeks restless people, focused on evolving to learn, on producing meaningful impacts, and on working in a highly collaborative way, in a Digital and Tech context. We want to meet people who are digital natives and full of good energy and a good attitude.

CRO is where opinions go to be tested. The job is to find where a funnel loses people, form a hypothesis about why, and design an experiment that can actually answer it. Most of the value is in the research and the prioritisation; the test is just how you find out whether you were right.

It is also a seat that requires a certain stubbornness about evidence. Roughly two thirds of tests do not win, and a specialist who reports otherwise is either lucky or rounding. You will need to be comfortable telling a client that their favourite idea did nothing, and to have the numbers ready when you do. Like everyone here, you will be judged on the marginal value you add to the company and to the projects you touch.

Key Responsibilities

• Conversion Research: Find the friction: funnel and drop-off analysis, heatmaps, session replay, form analytics, plus the qualitative side through surveys and user feedback.
• Hypotheses: Turn findings into hypotheses that state what you expect to change and why, rather than a list of improvements.
• Prioritisation: Rank a backlog with ICE, PIE or whatever the client can actually live with, and defend the order. Our own framework, PIRATE, gives the sequence a shape, and you will learn it here rather than arrive knowing it.
• Test Design: Design A/B, A/B/n, multivariate and split-URL tests with the sample size, duration and success metric agreed before the test starts.
• Implementation: Build or brief the variants, and validate that the test is running as designed before trusting a single number.
• Analysis: Read results with statistical care: significance, power, segment effects, and the discipline not to stop a test because it looks good on day three.
• Full-Funnel Work: Take the work beyond the landing page, from ad to page to checkout to the CRM behind it.
• Programme Building: Help a client build a testing habit: cadence, documentation, a shared record of what has been tried and what it taught us.
• Reporting: Report in business terms, revenue and conversion rate, and be equally clear about the tests that lost.

Technical & Platform Skills

• Experience: 2 to 4 years in CRO, experimentation, growth or digital analytics with hands-on testing behind you.
• Statistical literacy: A working understanding of sample size, significance, power and the traps: peeking, multiple comparisons, novelty effects.
• Analytics: Comfort in Google Analytics 4 and with the behavioural tooling that shows what a page actually does: heatmaps, session replay, funnel reports.
• Testing practice: Experience running A/B tests end to end in some tool, whatever it was.
• Web fundamentals: Enough HTML, CSS and JavaScript to read a variant, brief one properly, and spot when a test is broken.
• Commercial reasoning: Ability to connect a conversion rate to revenue, margin and what the client is actually trying to grow.
• AI literacy: Literacy in Tech and AI subjects, and sophisticated use of AI platforms in the research and testing loop, both with efficiency and security: synthesising sessions, surveys and feedback, and generating variants, without letting the tool manufacture a pattern that is not in the data.
• Languages: Fluent Portuguese and solid English.

Behavioral Skills

• Kindness: At Wise Pirates we promote and admire kindness, independently of rhythm, intensity and efficiency.
• Curiosity: You want to understand why something behaves the way it does, and you keep asking after the first answer.
• Ownership: Accountability for what you deliver and for what you promise a client.
• Collaborative Spirit: Proactive in working across multi-disciplinary teams, sharing knowledge rather than holding it.
• Analytical Mindset: Capable of putting data first and obsessed with insight building, always with client satisfaction and business results in mind.
• AI Readiness: Interest and fluency in using AI as a partner to deliver efficient value, respecting security and privacy regulations.
• Results-Oriented Zeal: An unwavering commitment to the client’s bottom line, pushing boundaries to chase the best overall performance and business goals.

Nice to Have

• Additional years of experience beyond the range above, for a broader remit and more ownership over how the discipline is run.
• Hands-on with a dedicated experimentation platform, client-side or server-side.
• Server-side or edge testing, and the flicker problem it solves.
• Bandit or adaptive testing, and knowing when it beats a fixed-horizon test.
• E-commerce experience: catalogue, checkout, payment and post-purchase.
• Lead generation funnels, forms and lead quality as an outcome rather than volume.
• Personalisation or segment-level targeting.
• UX research or usability testing in your own hands.
• Copywriting for tests, or working closely with someone who does it.
• Tag management and building your own tracking for a test.
• Using generative AI to synthesise session data or generate variants.
• Experience with incrementality testing or geo experiments.