Remote Senior Web Scraping Data Engineer

Jobgether; Belgique; Sur place; EUR 90 000 - 120 000; Plein temps

Avantages offerts par ce poste

Fully remote

Full-time

Autonomy

Résumé du poste

Jobgether is recruiting a Senior Data Engineer - Web Scraping for a fully remote role based in Belgium. You will design and maintain sophisticated web scrapers and data pipelines, transforming diverse sources into reliable datasets to support analytical and investment decisions.

The role combines hands-on Python development, data transformation, and workflow orchestration, with collaboration across analysts, engineers, and cross-functional teams.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical discipline.
• 4–6 years of professional experience in data engineering or a closely related field.
• Strong programming skills in Python and strong knowledge of SQL and database technologies.
• Advanced hands-on expertise with the Python Pandas library for data cleaning, manipulation, exploration, and transformation.
• Strong web-scraping experience with Selenium, Scrapy, Fiddler, Postman, and XPath.
• Strong experience with Apache Airflow for workflow orchestration and data pipeline management.
• Solid understanding of web technologies, including HTML, JavaScript, APIs, and related concepts.

Responsabilités

• Design, develop, deploy, and maintain web scrapers using a range of scraping techniques and tools to collect datasets from diverse sources.
• Use Python and Pandas to clean, explore, transform, manipulate, and prepare large datasets for downstream consumption.
• Build and maintain data pipelines that ingest scraped data into databases and data warehouses.
• Develop and manage scheduled workflows using Apache Airflow and other orchestration tools for reliable data delivery.
• Collaborate with analysts and stakeholders to translate requirements into technical solutions.
• Develop quality-control checks to validate data availability, accuracy, and integrity.
• Maintain alerting systems and resolve operational issues to ensure reliable data delivery.
• Design and implement tools and automation to improve web-scraping platform capabilities.
• Contribute to infrastructure and data-product design to support data scientists and tech teams.

Connaissances

Python

SQL

Data wrangling

Communication

Formation

Bachelor's or Master's in CS/Engineering

Outils

Selenium

Scrapy

Airflow

Docker

Kubernetes

GitHub Actions

AWS

Description du poste

Jobgether is recruiting a Senior Data Engineer - Web Scraping for a fully remote role based in Belgium. You will design and maintain sophisticated web scrapers and data pipelines, transforming diverse sources into reliable datasets to support analytical and investment decisions.

The role combines hands-on Python development, data transformation, and workflow orchestration, with collaboration across analysts, engineers, and cross-functional teams.