Senior Scraper Engineer | Python, Scrapy, Flexible Hours

NielsenIQ; Warszawa; Hybrid; PLN 132,000 - 195,000; Full time

Benefits offered by this job

Flexible working environment

Volunteer time off

Job summary

NielsenIQ is seeking a seasoned Python developer to join the Digital Shelf scraping team in Warsaw. You will design distributed architectures that scale across thousands of domains and reverse engineer mobile APIs to extract high-quality data quickly and at scale.

You will collaborate with Customer Success, Operations, and Data teams to push boundaries, experiment, and share knowledge, while applying a hacker-engineer mindset to innovate and deliver impact.

Qualifications

• 5+ years of Python and large-scale scraping experience.
• Independent thinker who solves novel problems.
• Familiarity with Parquet/Avro or real-time streams.
• Strong knowledge of MongoDB, InfluxDB, Redis and optimization.
• Experience with real-device simulation for mobile scraping.
• Experience maintaining distributed queues (Celery, Kafka).
• Experience scraping high-security/mobile-first environments.
• Exposure to Linux or cloud environments (AWS, GCP).
• Basic understanding of Kubernetes, Cloud Run and Cloud Functions.

Responsibilities

• Design and build distributed scraping architectures scalable across thousands of domains.
• Reverse engineer APIs and mobile apps using Frida, mitmproxy, Charles Proxy and Burp Suite.
• Lead technical innovation in scraping by prototyping new approaches.
• Set up anomaly detection and monitoring to detect blockers or failures early.

Skills

Python

Large-scale scraping

Independent thinker

Parquet/Avro

MongoDB

Real-device simulation

Distributed queues

Security-focused scraping

Linux / Cloud

Kubernetes basics

Tools

Frida

mitmproxy

Charles Proxy

Burp Suite

Job description

NielsenIQ is seeking a seasoned Python developer to join the Digital Shelf scraping team in Warsaw. You will design distributed architectures that scale across thousands of domains and reverse engineer mobile APIs to extract high-quality data quickly and at scale.

You will collaborate with Customer Success, Operations, and Data teams to push boundaries, experiment, and share knowledge, while applying a hacker-engineer mindset to innovate and deliver impact.