Senior Web Scraper & Python Crawler Architect

Nabla; Madrid; Híbrido; EUR 42.000 - 65.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Flexible working environment

Volunteer time off

LinkedIn Learning

Employee-Assistance-Program (EAP)

Descripción de la vacante

NIQ is seeking a Python Developer to join the scraping team in Madrid. You will design, implement and document robust Scrapy spiders, ensuring resilience to site changes and high data quality.

Responsibilities include reviewing code and data, leveraging HTTP and browser behaviors, and building web crawlers that bypass anti-bot measures, while contributing to multiple codebases and providing documentation and training as needed.

Formación

• Master's degree in Computer Science, IT, or related field.
• At least 3 years of professional experience in software engineering.
• Knowledge of BeautifulSoup or Scrapy framework.
• Familiarity with HTML and JavaScript, with a solid understanding of single-page applications.
• Experience with RESTful and/or GraphQL APIs.
• Hands-on experience with major Python web frameworks such as Django, FastAPI, or similar.
• Knowledge of the scraping framework, Scrapy is a plus.
• Experience with time series databases, such as InfluxDB, is advantageous.
• Strong skills in Docker, Git, pandas, regular expressions, Linux, and bash scripting.
• Proven experience with major cloud providers such as AWS, GCP, or Azure.
• You are enthusiastic, motivated, autonomous.
• You like tackling mentally-stimulating software engineering challenges.
• You are passionate about tech and learning new things.

Responsabilidades

• Design, implement, and document robust Scrapy spiders, ensuring resilience against future website changes while maintaining existing ones.
• Conduct comprehensive code review and data validation to maintain high standards of code and data quality.
• Leverage knowledge of HTTP, modern browser mechanisms, and internal tools to design sophisticated web crawling solutions that bypass anti-bot measures.
• Architect and contribute to significant new developments across multiple codebases, providing clear technical documentation and conducting training sessions when necessary.

Conocimientos

Python

Web scraping

RESTful APIs

GraphQL APIs

Django/FastAPI

Docker

Git

Linux

Regular expressions

InfluxDB

AWS/GCP/Azure

Educación

Master's degree in Computer Science or related field

Herramientas

BeautifulSoup

Scrapy

HTML/JavaScript

Time series DB (InfluxDB)

Cloud platforms (AWS/GCP/Azure)

Descripción del empleo

NIQ is seeking a Python Developer to join the scraping team in Madrid. You will design, implement and document robust Scrapy spiders, ensuring resilience to site changes and high data quality.

Responsibilities include reviewing code and data, leveraging HTTP and browser behaviors, and building web crawlers that bypass anti-bot measures, while contributing to multiple codebases and providing documentation and training as needed.