Senior Web Scraper (Python) — Scale & Innovation

NielsenIQ

Madrid

On-site

EUR 50,000 - 65,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Flexible working environment
Volunteer time off

Job summary

NIQ Digital shelf is hiring a senior scraping engineer to design scalable architectures that process billions of data points from diverse sources. You will reverse engineer APIs, prototype innovative approaches, and drive reliability with monitoring in a fast-paced, global team.

You will collaborate with Customer Success, Operations, and Data to deliver high-quality, actionable insights at scale while thinking like an inventor and hacker to push the boundaries of what is possible.

Qualifications

  • 5+ years of experience with Python and large-scale scraping projects.
  • Independent thinking and strong problem-solving skills.
  • Familiarity with Parquet, Avro, or real-time stream processing.
  • Good knowledge of MongoDB, InfluxDB, Redis and how to optimize them.
  • Experience with real-device simulation for mobile scraping.
  • Comfortable building and maintaining distributed task queues (Celery, Kafka, etc.).
  • Experience scraping high-security platforms or mobile-first environments.
  • Exposure to Linux or cloud environments (AWS, GCP).
  • Basic understanding of Kubernetes, Cloud Run, and Cloud Functions to deploy and orchestrate scraping workloads.

Responsibilities

  • Design and build distributed scraping architectures that can scale across thousands of domains.
  • Reverse engineer APIs and mobile apps using tools like Frida, mitmproxy, Charles Proxy, burp and many more.
  • Lead technical innovation in scraping: identify edge cases, prototype new approaches, and share knowledge with the team.
  • Set up anomaly detection and monitoring to detect blockers or failures early

Skills

Independent thinking
Problem solving
Analytical mindset
Team collaboration
Willingness to learn

Tools

Python
Frida
mitmproxy
Charles Proxy
Burp Suite
Celery
Kafka
Linux
AWS
GCP
Kubernetes
Cloud Run
Cloud Functions
Parquet
Avro
MongoDB
InfluxDB
Redis
Real-device simulation

Job description

NIQ Digital shelf is hiring a senior scraping engineer to design scalable architectures that process billions of data points from diverse sources. You will reverse engineer APIs, prototype innovative approaches, and drive reliability with monitoring in a fast-paced, global team.

You will collaborate with Customer Success, Operations, and Data to deliver high-quality, actionable insights at scale while thinking like an inventor and hacker to push the boundaries of what is possible.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Scraping Engineer — Scale & Innovate with Data
Senior Scraping Engineer — Scale & Innovate with Data

NielsenIQ • Spain

On-site
EUR 65,000 - 90,000
Flexible working environment
Volunteer time off
LinkedIn Learning
+1
Senior Web Scraper (Scrapy)
Senior Web Scraper (Scrapy)

NielsenIQ • Madrid

On-site
EUR 50,000 - 65,000
Flexible working environment
Volunteer time off
EU Engineering Manager, Web Data Acquisition & Scraping
EU Engineering Manager, Web Data Acquisition & Scraping

NielsenIQ • San Sebastián de los Reyes

On-site
EUR 60,000 - 70,000
Flexible working environment
Volunteer time off
Senior Software Engineer (Web Scraping, Data acquisition, Data collection)
Senior Software Engineer (Web Scraping, Data acquisition, Data collection)

NielsenIQ • Spain

On-site
EUR 65,000 - 90,000
Flexible working environment
Volunteer time off
LinkedIn Learning
+1
Europe Engineering Manager, Web Data Acquisition
Europe Engineering Manager, Web Data Acquisition

NielsenIQ • Madrid

On-site
EUR 110,000 - 150,000
Flexible working environment
Volunteer time off
LinkedIn Learning
+1
Engineering Manager, Web Data Acquisition
Engineering Manager, Web Data Acquisition

NielsenIQ • Madrid

On-site
EUR 110,000 - 150,000
Flexible working environment
Volunteer time off
LinkedIn Learning
+1
Engineering Manager, Web Data Acquisition
Engineering Manager, Web Data Acquisition

NielsenIQ • Comunidad de Madrid

On-site
EUR 60,000 - 70,000
Flexible working environment
Volunteer time off
Senior AI-Driven Data Scraper & Backend Engineer
Senior AI-Driven Data Scraper & Backend Engineer

Wayops • Madrid

On-site
EUR 70,000 - 90,000
Engineering Manager, Web Data Acquisition
Engineering Manager, Web Data Acquisition

NielsenIQ • San Sebastián de los Reyes

On-site
EUR 60,000 - 70,000
Flexible working environment
Volunteer time off
Senior Antibot Engineer
Senior Antibot Engineer

NielsenIQ • Barcelona

On-site
EUR 46,000 - 70,000
Flexible working environment
Volunteer time off