Senior Web Scraping Architect: Scale Data Globally

Nielseniq-; España; Presencial; EUR 46.000 - 55.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Ownership and freedom to experiment

Flexible hours

Volunteer time off

Descripción de la vacante

NIQ Digital shelf is seeking a Senior Software Engineer to design and build distributed web scraping systems that scale across thousands of domains. You will reverse engineer APIs and mobile apps using Frida, mitmproxy, Charles Proxy, Burp and related tools, and lead technical innovation in scraping with a focus on high-quality data and speed.

You will collaborate with Customer Success, Operations, and Data teams to ensure we extract actionable data at scale.

Formación

• 5+ years of experience with Python and large-scale scraping projects.
• You think independently and enjoy solving problems no one has solved before.
• Familiarity with Parquet, Avro, or real-time stream processing.
• Good knowledge of databases like MongoDB, InfluxDB, and Redis, including how they work and how to optimize them.
• Experience with real-device simulation for mobile scraping.

Responsabilidades

• Design and build distributed scraping architectures that can scale across thousands of domains.
• Reverse engineer APIs and mobile apps using tools like Frida, mitmproxy, Charles Proxy, burp and many more.
• Lead technical innovation in scraping: identify edge cases, prototype new approaches, and share knowledge with the team.
• Set up anomaly detection and monitoring to detect blockers or failures early.

Conocimientos

Python

Data scraping

Distributed systems

Linux/Cloud

Celery/Kafka

Kubernetes

Real-device simulation

Herramientas

Frida

mitmproxy

Charles Proxy

Burp

MongoDB

InfluxDB

Redis

Celery

Kafka

AWS

GCP

Kubernetes

Cloud Run

Cloud Functions

Descripción del empleo

NIQ Digital shelf is seeking a Senior Software Engineer to design and build distributed web scraping systems that scale across thousands of domains. You will reverse engineer APIs and mobile apps using Frida, mitmproxy, Charles Proxy, Burp and related tools, and lead technical innovation in scraping with a focus on high-quality data and speed.

You will collaborate with Customer Success, Operations, and Data teams to ensure we extract actionable data at scale.