Remote-First Senior Anti-Bot & Web Scraping Engineer

Adthena; Greater London; Hybrid; GBP 85,000 - 125,000; Full time

Benefits offered by this job

Startup culture

Strong culture

Award-winning product

Stock options

Vacation policy

Remote-first

Flexible work

Career growth

Hackdays & Training

Family care

Home office stipend

Swag gift

Birthday off

Socials

Volunteer days

Job summary

Adthena, a leading paid search intelligence platform, is seeking a Senior Anti-Bot Engineer to design, build, and operate large-scale scraping systems. You will focus on Google-like search environments and tackle dynamic rendering, anti-bot defences, and high-volume data collection.

Role intersects data engineering, reverse engineering, and reliability. We value agentic coding and collaboration with cross-functional teams to deliver trustworthy data at scale.

Qualifications

• Strong professional experience with Python and production-grade scraping systems.
• Deep hands-on experience scraping Google or similarly protected platforms.
• Solid understanding of HTTP, TLS, cookies, headers, redirects, and browser networking behaviour.
• Experience with browser automation frameworks like Playwright/Selenium/Puppeteer.
• Strong knowledge of HTML parsing, DOM traversal, and data extraction techniques.
• Experience handling rate limiting, CAPTCHA, IP rotation, and bot detection systems.
• Comfortable working with asynchronous and concurrent scraping architectures.

Responsibilities

• Design and maintain large-scale Python scraping systems that operate reliably against Google and other highly defended websites.
• Build scrapers for dynamic, JavaScript-heavy pages using browser automation and hybrid approaches.
• Continuously adapt to changes in page structure, request flows, and anti-automation mechanisms.
• Engineer robust extraction pipelines that prioritise data accuracy, consistency, and observability.
• Implement proxy, fingerprinting, and request-routing strategies to maximise stability and throughput.
• Monitor scrape health, detect failures early, and rapidly debug production issues.
• Optimise performance, cost, and latency across scraping infrastructure.
• Work closely with data engineers, data scientists, and product teams to ensure scraped data is usable and trusted.
• Document scraping logic and operational runbooks for long-term maintainability.

Skills

Python

Browser automation

HTML parsing

Anti-bot

Cloud deployment

Debugging

Tools

Playwright

Selenium

Puppeteer

Docker

Kubernetes

Job description

Adthena, a leading paid search intelligence platform, is seeking a Senior Anti-Bot Engineer to design, build, and operate large-scale scraping systems. You will focus on Google-like search environments and tackle dynamic rendering, anti-bot defences, and high-volume data collection.

Role intersects data engineering, reverse engineering, and reliability. We value agentic coding and collaboration with cross-functional teams to deliver trustworthy data at scale.