Remote AI Web Scraping Engineer: Stealth Data Pipelines

Workana; United States; Remote; USD 140,000 - 210,000; Full time

Benefits offered by this job

Compensation in USD

Fully remote work

Career growth on an international公司

Job summary

Pinwheel API is seeking an AI Web Scraping Engineer (Stealth Data Acquisition) to design and maintain resilient, undetectable data-collection pipelines at scale. You will move beyond basic requests to defeat modern anti-bot defenses while ensuring compliant, structured data delivery.

You will integrate AI/LLM-based parsing, build self-healing scrapers, and collaborate with data engineering to produce clean datasets for downstream systems in a fast-moving, evolving environment.

Qualifications

• 4+ years building production web scraping systems at scale.
• Deep hands-on experience with headless browser automation (Playwright, Puppeteer, Selenium).
• Practical experience defeating anti-automation measures (Cloudflare, DataDome, PerimeterX, Akamai, Kasada).
• Strong understanding of TLS/HTTP fingerprinting and browser fingerprint spoofing.
• Experience with residential/mobile/datacenter proxy rotation and session management at scale.
• Proficiency in Python and/or Node.js/TypeScript for scraping and orchestration.
• Experience using LLMs/AI models for content extraction, parsing, and classification.
• Familiarity with CAPTCHA-solving approaches and detection-avoidance strategies.
• Must be based in and authorized to work in the United States.
• Must pass a standard background check prior to start.
• Comfortable working in a fast-moving, iterative environment where sites frequently change defenses.

Responsibilities

• Stealth Scraping Pipeline Development – Design, build, and maintain stealth-based scraping pipelines that evade bot detection and rate-limiting defenses.
• Anti-Bot Reverse Engineering – Reverse-engineer anti-automation measures and build countermeasures.
• Distributed Infrastructure Architecture – Architect distributed scraping infra using rotating proxies and headless browser farms.
• AI-Powered Parsing Integration – Integrate AI/LLM-based parsing for dynamic layouts without brittle selectors.
• Self-Healing Scraper Development – Build scrapers that adapt to layout/DOM changes automatically.
• Monitoring & Iteration – Track scraper health, success rates, and detection signals, iterating as defenses update.
• Compliance & Legal Guardrails – Ensure pipelines align with ToS, robots.txt, and rate limiting as directed by legal/compliance.
• Data Pipeline Collaboration – Deliver clean, deduplicated datasets to downstream systems.

Skills

Web scraping infra

Headless browser automation

Stealth scraping

Anti-bot bypass

TLS fingerprinting

Proxy rotation

Session management

Python

TypeScript/Node.js

LLM parsing

CAPTCHA solving

US work authorization

Tools

Playwright

Puppeteer

Selenium

LLM parsing tooling

Job description

Pinwheel API is seeking an AI Web Scraping Engineer (Stealth Data Acquisition) to design and maintain resilient, undetectable data-collection pipelines at scale. You will move beyond basic requests to defeat modern anti-bot defenses while ensuring compliant, structured data delivery.

You will integrate AI/LLM-based parsing, build self-healing scrapers, and collaborate with data engineering to produce clean datasets for downstream systems in a fast-moving, evolving environment.