Senior Web Scraping Engineer: Scale Data & Innovate

NielsenIQ; Województwo mazowieckie; On-site; PLN 120,000 - 170,000; Full time

Benefits offered by this job

Flexible working environment

Volunteer time off

LinkedIn Learning

Employee-Assistance-Program (EAP)

Job summary

NIQ is seeking a senior scraping engineer to design scalable distributed systems for data extraction and visibility across thousands of domains. You will reverse engineer APIs, bypass anti-bot measures, and push technical boundaries with a global team of experts.

You’ll work with Scrapy, Requests, httpx, Selenium, Playwright, and real-device simulations, while handling proxies and advanced debugging across browsers and networks.

Qualifications

• 5+ years of Python and large-scale scraping experience.
• Deep knowledge of anti-bot tech and bypass methods.
• Experience with Scrapy, Requests, httpx, Selenium, Playwright.
• Proxy handling: residential, datacenter, rotating; session control.
• Strong debugging across browser, HTTP traffic, and devices.
• Familiar with Parquet/Avro or real-time streaming concepts.
• Knowledge of MongoDB, InfluxDB, Redis and optimization basics.
• Independent thinker who enjoys solving hard problems.

Responsibilities

• Design and build distributed scraping architectures at scale.
• Reverse engineer APIs and mobile apps using tool suites listed above.
• Detect anti-bot measures and adapt crawlers to appear human-like.
• Lead technical innovation, prototype new approaches, share knowledge.
• Set up anomaly detection and monitoring to catch blockers early.
• Collaborate with Customer Success, Operations, and Data teams.

Skills

Python

Large-scale scraping

Problem solving

Independent thinker

Data analysis

Debugging

Anti-bot concepts

Tools

Frida

mitmproxy

Charles Proxy

burp

Scrapy

Requests

httpx

Selenium

Playwright

headless browsers

Proxies management

Kubernetes (basic)

Celery / Kafka (concepts)

Job description

NIQ is seeking a senior scraping engineer to design scalable distributed systems for data extraction and visibility across thousands of domains. You will reverse engineer APIs, bypass anti-bot measures, and push technical boundaries with a global team of experts.

You’ll work with Scrapy, Requests, httpx, Selenium, Playwright, and real-device simulations, while handling proxies and advanced debugging across browsers and networks.