Remote Junior Data Engineer — Python Web Scraping & QA

Madfish; Remote; GBP 30,000 - 45,000; Full time

Job summary

A data startup is looking for a motivated Junior Data Engineer to join their team. In this role, you will develop Python-based web scrapers to gather data, utilize various technologies for efficient data extraction and normalization, and ensure the reliability of data through validation pipelines. The ideal candidate is experienced in Python and web scraping, has a problem-solving attitude, and is eager to work in a collaborative and innovative remote environment.

Qualifications

• Solid experience in Python, especially in building web scrapers.
• Familiarity with libraries like Selenium, BeautifulSoup, or Scrapy.
• Basic understanding of data validation, data cleaning, and monitoring best practices.

Responsibilities

• Develop and maintain Python-based web scrapers to collect structured and unstructured data.
• Package scrapers as Docker containers and deploy them to Kubernetes.
• Set up Grafana dashboards to monitor pipeline health and data quality metrics.

Skills

Python

Web scraping

Data validation

Problem-solving

Tools

Selenium

Docker

Airflow

Grafana

Kubernetes

Pandas

Job description

A data startup is looking for a motivated Junior Data Engineer to join their team. In this role, you will develop Python-based web scrapers to gather data, utilize various technologies for efficient data extraction and normalization, and ensure the reliability of data through validation pipelines. The ideal candidate is experienced in Python and web scraping, has a problem-solving attitude, and is eager to work in a collaborative and innovative remote environment.