Senior Python Web Scraper Architect (Scrapy/BeautifulSoup)

Nabla; Madrid; Presencial; EUR 55.000 - 75.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Flexible working environment

Volunteer time off

LinkedIn Learning

Employee-Assistance-Program (EAP)

Descripción de la vacante

NIQ for Digital Commerce in Madrid is seeking a Senior Python Developer to join the scraping team and optimize data collection, ensuring resilience to website changes.

You will design, implement, and document robust Scrapy spiders, perform code reviews, work with REST/GraphQL APIs, and share training across teams while upholding data quality and reliability. This role offers a flexible, learning-oriented environment with opportunities to work with cross-functional teams.

Formación

• Master's degree in Computer Science, IT, or a related field.
• At least 3 years of professional experience in software engineering.
• Knowledge of BeautifulSoup or Scrapy framework.
• Familiarity with HTML and JavaScript, with a solid understanding of single-page applications.
• Experience with RESTful and/or GraphQL APIs.
• Hands-on experience with major Python web frameworks such as Django, FastAPI, or similar.
• Knowledge of the scraping framework, Scrapy is a plus.
• Experience with time series databases, such as InfluxDB, is advantageous.
• Strong skills in Docker, Git, pandas, regular expressions, Linux, and bash scripting.
• Proven experience with major cloud providers such as AWS, GCP, or Azure.
• You are enthusiastic, motivated, autonomous.
• You like tackling mentally-stimulating software engineering challenges.
• You are passionate about tech and learning new things.

Responsabilidades

• Design, implement, and document robust Scrapy spiders, ensuring resilience against future website changes while maintaining existing ones.
• Conduct comprehensive code review and data validation to maintain high standards of code and data quality.
• Leverage knowledge of HTTP protocol, browser mechanisms, and internal tools to design sophisticated web crawling solutions that bypass anti-bot countermeasures.
• Architect and contribute to significant new developments across multiple codebases, providing documentation and training as needed.

Conocimientos

Python

Django/FastAPI

Scrapy

REST API

GraphQL

Docker

Git

Linux

Bash

Pandas

Educación

Master's degree in Computer Science/IT

Herramientas

Scrapy

BeautifulSoup

InfluxDB

AWS

GCP

Azure

Descripción del empleo

NIQ for Digital Commerce in Madrid is seeking a Senior Python Developer to join the scraping team and optimize data collection, ensuring resilience to website changes.

You will design, implement, and document robust Scrapy spiders, perform code reviews, work with REST/GraphQL APIs, and share training across teams while upholding data quality and reliability. This role offers a flexible, learning-oriented environment with opportunities to work with cross-functional teams.