Senior Python Scraper Engineer

Nabla; Lisboa; Presencial; EUR 45 000 - 70 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Flexible working environment

Volunteer time off

LinkedIn Learning

Employee-Assistance-Program (EAP)

Resumo da oferta

NIQ is seeking a Senior Python Developer to join the scraping team in Lisbon. You will design, implement, and maintain robust spiders, ensure data quality, and develop advanced crawling solutions while staying ahead of anti-bot countermeasures.

You will work with Django/FastAPI, Scrapy, and cloud services, collaborate across teams, document technical designs, and help train others. A Master in CS and 5–6 years of experience are expected.

Qualificações

• Master's degree in Computer Science, IT, or a related field.
• 5–6 years of professional software engineering experience.
• Knowledge of BeautifulSoup or Scrapy framework.
• Familiarity with HTML/JavaScript, and understanding of SPAs.
• Experience with RESTful and/or GraphQL APIs.
• Hands-on experience with Python web frameworks such as Django/FastAPI.
• Knowledge of Scrapy is a plus.
• Experience with time series databases like InfluxDB is advantageous.
• Strong Docker, Git, pandas, regex, Linux, and bash scripting skills.
• Experience with AWS, GCP, or Azure.

Responsabilidades

• Design, implement, and document robust Scrapy spiders, ensuring resilience against future website changes while maintaining existing ones.
• Conduct comprehensive code review and data validation to maintain high code and data quality.
• Leverage HTTP, browser behaviors, and internal tools to design sophisticated web crawling solutions that bypass advanced anti-bot measures.
• Architect and contribute to significant new developments across multiple codebases, with clear technical documentation and training when necessary.

Conhecimentos

Python

Scrapy

BeautifulSoup

REST/GraphQL

Docker

Git

pandas

Regular expressions

Linux

Bash scripting

AWS

GCP

Azure

Django/FastAPI

HTML/JS

InfluxDB

Autonomous

Formação académica

Master's degree in Computer Science

Ferramentas

Django

FastAPI

Descrição da oferta de emprego

NIQ is seeking a Senior Python Developer to join the scraping team in Lisbon. You will design, implement, and maintain robust spiders, ensure data quality, and develop advanced crawling solutions while staying ahead of anti-bot countermeasures.

You will work with Django/FastAPI, Scrapy, and cloud services, collaborate across teams, document technical designs, and help train others. A Master in CS and 5–6 years of experience are expected.