Senior Anti-Bot & Web Scraping Engineer

Openkrill; United States; Remote; USD 140,000 - 190,000; Full time

Benefits offered by this job

Stock Options

Remote-first

Home Office Stipend

Job summary

Adthena is a leading AI-powered paid search intelligence platform. We design and operate large-scale scraping systems to deliver accurate, timely data from Google and other protected sites. This Senior Anti-Bot Engineer role focuses on building robust pipelines, adapting to changing page structures, and ensuring data trust at scale.

Remote-first with EU remote options and global teams. Exciting career growth, autonomy, and a culture that rewards practical problem-solving in fast-changing

Qualifications

• Experience with Python and production-grade scraping systems.
• Experience scraping Google or similarly protected platforms.
• Understanding of HTTP, TLS, cookies, headers, redirects, and browser networking behaviour.
• Experience with browser automation tools (Playwright, Selenium, Puppeteer).
• Strong knowledge of HTML parsing, DOM traversal, and data extraction techniques.
• Experience handling rate limiting, CAPTCHA, IP rotation, and bot detection systems.
• Comfortable with asynchronous and concurrent scraping architectures.
• Experience running scrapers at scale in cloud environments.
• Strong debugging skills and ability to reason about complex failure modes.
• Experience with headless browser fingerprinting and anti-bot evasion techniques.

Responsibilities

• Design and maintain large-scale Python scraping systems that operate reliably against Google and other highly defended websites.
• Build scrapers for dynamic, JavaScript-heavy pages using browser automation and hybrid approaches.
• Continuously adapt to changes in page structure, request flows, and anti-automation mechanisms.
• Engineer robust extraction pipelines that prioritise data accuracy, consistency, and observability.
• Implement proxy, fingerprinting, and request-routing strategies to maximise stability and throughput.
• Monitor scrape health, detect failures early, and rapidly debug production issues.
• Optimise performance, cost, and latency across scraping infrastructure.
• Work closely with data engineers, data scientists, and product teams to ensure scraped data is usable and trusted.
• Document scraping logic and operational runbooks for long‑term maintainability.

Skills

Python

GoLang

Rust

JavaScript

Browser automation

Web scraping

HTTP networking

Asynchronous programming

Debugging

Fingerprinting

Tools

Playwright

Selenium

Puppeteer

Job description

Adthena is a leading AI-powered paid search intelligence platform. We design and operate large-scale scraping systems to deliver accurate, timely data from Google and other protected sites. This Senior Anti-Bot Engineer role focuses on building robust pipelines, adapting to changing page structures, and ensuring data trust at scale.

Remote-first with EU remote options and global teams. Exciting career growth, autonomy, and a culture that rewards practical problem-solving in fast-changing