Senior Anti-Bot Engineer — Large-Scale Web Scraping

Adthena; United States; Remote; USD 120,000 - 170,000; Full time

Benefits offered by this job

Remote-First

Stock Options

Home Office Stipend

Birthday Off

Volunteer Days

Job summary

Adthena is seeking a Senior Anti-Bot Engineer to design, build, and operate large-scale web scraping systems focused on Google and other defended sites. You will work at the intersection of data engineering, reverse engineering, and reliability to deliver accurate, timely data at scale.

You will tackle dynamic rendering, anti-bot defenses, and high-volume collection, leveraging AI-assisted coding practices to improve your skills and outcomes in a remote-friendly, fast-growing tech environment.

Qualifications

• Strong experience with Python and production-grade scraping systems.
• Hands-on experience scraping Google or similarly protected platforms.
• Solid understanding of HTTP, TLS, cookies, headers, and browser networking behaviour.
• Experience with Playwright, Selenium, or Puppeteer.
• Experience handling rate limiting, CAPTCHA, IP rotation, and bot detection systems.
• Experience with headless browser fingerprinting and anti-bot evasion techniques.

Responsibilities

• Design and maintain large-scale Python scraping systems that operate reliably against Google and other highly defended websites.
• Build scrapers for dynamic, JavaScript-heavy pages using browser automation and hybrid approaches.
• Continuously adapt to changes in page structure, request flows, and anti-automation mechanisms.
• Engineer robust extraction pipelines that prioritise data accuracy, consistency, and observability.
• Implement proxy, fingerprinting, and request-routing strategies to maximise stability and throughput.
• Monitor scrape health, detect failures early, and rapidly debug production issues.
• Optimise performance, cost, and latency across scraping infrastructure.
• Work closely with data engineers, data scientists, and product teams to ensure scraped data is usable and trusted.
• Document scraping logic and operational runbooks for long-term maintainability.

Skills

Python

Web scraping

HTML parsing

Browser automation

Async scraping

Tools

Playwright

Selenium

Puppeteer

Docker

Kubernetes

Job description

Adthena is seeking a Senior Anti-Bot Engineer to design, build, and operate large-scale web scraping systems focused on Google and other defended sites. You will work at the intersection of data engineering, reverse engineering, and reliability to deliver accurate, timely data at scale.

You will tackle dynamic rendering, anti-bot defenses, and high-volume collection, leveraging AI-assisted coding practices to improve your skills and outcomes in a remote-friendly, fast-growing tech environment.