Senior Web Scraping Data Engineer - Remote

Jobgether

Poland

On-site

PLN 180,000 - 240,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Fully remote position

Job summary

Jobgether is seeking a Senior Data Engineer focused on web scraping based in Poland. This fully remote role involves designing and maintaining scrapers, building scalable data pipelines, and delivering high-quality, production-ready data products.

You will work with Python, Pandas, SQL, Airflow, and cloud services to transform diverse sources into reliable datasets. The position offers autonomy and opportunity to innovate within a fast-paced team.

Qualifications

Bachelor's or master's degree in Computer Science, Engineering, or a related technical discipline.
4-6 years of professional experience in data engineering or a closely related field.
Strong programming skills in Python and strong knowledge of SQL and database technologies.
Advanced hands-on expertise with the Python Pandas library for data cleaning, manipulation, exploration, and transformation.
Strong web-scraping experience with tools and technologies such as Selenium, Scrapy, Fiddler, Postman, and XPath.
Strong experience with Apache Airflow for workflow orchestration and data pipeline management.
Solid understanding of web technologies, including HTML, JavaScript, APIs, and related concepts.
Proven experience working with large datasets and performing data cleaning, transformation, manipulation, and replacement.
Ability to design scalable infrastructure, data products, and technical tools for data-focused teams.
Strong verbal and written communication skills, with the ability to collaborate effectively with technical and non-technical stakeholders.
Self-motivated, detail-oriented, and comfortable working independently while taking ownership of projects and outcomes.
Experience with Docker and workload containerization is preferred; Kubernetes experience is a plus.
Familiarity with automation and CI/CD technologies such as Jenkins and GitHub Actions is an advantage.
Experience with AWS services such as S3, RDS, SNS, SQS, and Lambda is a plus.

Responsibilities

Design, develop, deploy, and maintain web scrapers using a range of scraping techniques and tools to collect alternative datasets from diverse sources.
Use Python and Pandas to clean, explore, transform large datasets for downstream consumption.
Build and maintain data pipelines that ingest scraped data into databases and data warehouses.
Develop and manage scheduled workflows using Apache Airflow and other orchestration tools to ensure reliable and timely data delivery.
Collaborate with analysts and cross-functional stakeholders to translate data requirements into effective technical solutions.
Develop quality-control checks to validate data availability, accuracy, consistency, and integrity.
Maintain alerting systems, investigate time-sensitive data incidents, and resolve operational issues.
Design and implement tools and automation that improve the capabilities of the web-scraping platform.
Contribute to infrastructure and data-product design to support data scientists and other teams.
Work independently while collaborating with engineering, product, and technology stakeholders to deliver high-quality solutions.