Senior Anti-Bot & Web Scraping Engineer (Remote)

Remote Worker LTD.; United States; Remote; USD 159,000 - 238,000; Full time

Benefits offered by this job

Startup culture

Strong culture

Award-winning product

Stock options

Remote-first

Flexible work

Career growth

Hackdays & training

Maternity/paternity leave

Home office stipend

Swag gift credit

Birthday day off

Social events

Volunteer days

Job summary

Adthena is seeking a Senior Anti-Bot Engineer to design, build, and operate large-scale scraping systems focused on Google and similar platforms. You will work at the intersection of data engineering, reverse engineering, and reliability.

You will tackle dynamic rendering, anti-bot defenses, and high-volume data collection, leveraging AI-assisted tooling and modern browser automation. This role reports to the Head of Engineering and is remote from the UK.

Qualifications

• Strong experience with Python in production-grade scraping systems.
• Hands-on experience scraping Google or similarly protected platforms.
• Solid understanding of HTTP, TLS, cookies, headers, and browser networking.
• Experience with browser automation tools such as Playwright, Selenium, or Puppeteer.
• Strong knowledge of HTML parsing, DOM traversal, and data extraction.
• Experience handling rate limiting, CAPTCHA, IP rotation, and bot detection systems.
• Comfortable with asynchronous and concurrent scraping architectures.
• Experience running scrapers at scale in cloud environments.
• Strong debugging skills and ability to reason about complex failure modes.

Responsibilities

• Design and maintain large-scale Python scraping systems against Google and other defended sites.
• Build scrapers for dynamic, JavaScript-heavy pages using browser automation.
• Adapt to changes in page structure, request flows, and anti-automation measures.
• Engineer robust extraction pipelines prioritising accuracy, consistency, and observability.
• Implement proxy, fingerprinting, and request-routing strategies for stability.
• Monitor scrape health, detect failures early, and debug production issues.
• Optimize performance, cost, and latency across scraping infra.
• Collaborate with data engineers, data scientists, and product teams.
• Document scraping logic and runbooks for long-term maintainability.

Skills

Python

Google scraping

HTTP/TLS knowledge

Playwright

Selenium

Puppeteer

HTML parsing

Rate limiting/bot detection

Async/concurrent scraping

Cloud deployment

Debugging at scale

Fingerprinting evasion

Tools

Playwright

Selenium

Puppeteer

Job description

Adthena is seeking a Senior Anti-Bot Engineer to design, build, and operate large-scale scraping systems focused on Google and similar platforms. You will work at the intersection of data engineering, reverse engineering, and reliability.

You will tackle dynamic rendering, anti-bot defenses, and high-volume data collection, leveraging AI-assisted tooling and modern browser automation. This role reports to the Head of Engineering and is remote from the UK.