Senior Web Scraping Engineer Scalable Data Acquisition

NielsenIQ

Warszawa

Ibrido

PLN 132.000 - 195.000

Tempo pieno

2 giorni fa

Candidati tra i primi

Aumenta le possibilità di ricevere una risposta da questo datore di lavoro

Il tuo curriculum e una lettera di presentazione personalizzati, che corrispondono esattamente a ciò che sta cercando.

Supera i filtri ATS

Vantaggi offerti da questo lavoro

Flexible working environment

Volunteer time off

Competitive salary

Descrizione del lavoro

NIQ is seeking a Senior Software Engineer to design and build distributed web scraping architectures, processing tens of billions of data points daily for major retailers and brands.

You will reverse engineer APIs and mobile apps with Frida, mitmproxy, Charles Proxy, and Burp, lead technical innovations, and work with Customer Success, Operations, and Data teams to deliver high-quality data at scale.

Competenze

5+ years of experience with Python and large-scale scraping projects.
Experience with real-device simulation for mobile scraping.
Experience scraping high-security platforms or mobile-first environments.

Mansioni

Design and build distributed scraping architectures that can scale across thousands of domains.
Reverse engineer APIs and mobile apps using tools like Frida, mitmproxy, Charles Proxy, burp and many more.
Lead technical innovation in scraping: identify edge cases, prototype new approaches, and share knowledge with the team.
Set up anomaly detection and monitoring to detect blockers or failures early

Conoscenze

Python

Frida

mitmproxy

Charles Proxy

Burp Suite

MongoDB

Redis

Kafka

Celery

Kubernetes

AWS

GCP

Parquet

Avro

Strumenti