Senior Web Scraping Data Engineer – Remote

Jobgether; France; Sur place; EUR 70 000 - 100 000; Plein temps

Avantages offerts par ce poste

Fully remote position

Full-time opportunity

Autonomy and ownership

Exposure to advanced data platforms

Résumé du poste

Jobgether is seeking an experienced Senior Data Engineer - Web Scraping based in France. This fully remote role focuses on designing and maintaining scrapers, transforming web-derived data with Python and Pandas, and building scalable data pipelines.

You will collaborate with analysts and engineers to meet data requirements, implement QC checks, and automate processes with Airflow and other tools. The environment emphasizes ownership, reliability, and innovation.

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or a related technical discipline.
• 4-6 years of professional experience in data engineering or a closely related field.
• Strong programming skills in Python and strong knowledge of SQL and database technologies.
• Advanced hands-on expertise with the Python Pandas library for data cleaning, manipulation, exploration, and transformation.
• Strong web-scraping experience with Selenium, Scrapy, Fiddler, Postman, and XPath.
• Strong experience with Apache Airflow for workflow orchestration and data pipeline management.
• Solid understanding of web technologies, including HTML, JavaScript, APIs, and related concepts.

Responsabilités

• Design, develop, deploy, and maintain web scrapers to collect datasets from diverse sources.
• Use Python and Pandas to clean, transform, and prepare large datasets for downstream use.
• Build and maintain data pipelines that ingest scraped data into databases and data warehouses.
• Develop and manage scheduled workflows using Apache Airflow and other orchestration tools.
• Collaborate with analysts and stakeholders to translate data requirements into technical solutions.
• Develop quality-control checks to validate data availability, accuracy, and integrity.

Connaissances

Python

SQL

Pandas

Web scraping

Airflow

Docker

Kubernetes

Jenkins

GitHub Actions

AWS (S3, RDS)

Formation

Bachelors or Masters in CS/Engineering or related

Outils

Selenium

Scrapy

Fiddler

Postman

XPath

Description du poste

Jobgether is seeking an experienced Senior Data Engineer - Web Scraping based in France. This fully remote role focuses on designing and maintaining scrapers, transforming web-derived data with Python and Pandas, and building scalable data pipelines.

You will collaborate with analysts and engineers to meet data requirements, implement QC checks, and automate processes with Airflow and other tools. The environment emphasizes ownership, reliability, and innovation.