Remote Senior Python Data Scraping Engineer — AI-Driven

Mindrift; Manchester; On-site; GBP 38,013 - 54,140; Part time

Job summary

Mindrift is seeking a highly skilled Senior Python Data Scraping Engineer for the Tendem project. This part-time remote role involves driving specialized data scraping workflows.

As an AI Pilot, you will collaborate with Tendem Agents, providing quality control and domain expertise to ensure accurate data results. Candidates should have at least 5 years of experience in web scraping and strong skills in Python, with the ability to handle dynamic content and data cleaning.

The compensation for this role can reach up to $45 per hour, depending on contributions.

Qualifications

• 5+ years experience in web scraping or data engineering is required.
• Strong technical foundation with scripting and automation is essential.
• Experience with dynamic content and API proxies is crucial.

Responsibilities

• Own end-to-end data extraction workflows across complex websites.
• Leverage internal tools and custom workflows for data collection.
• Ensure reliable extraction from dynamic web sources.

Skills

Python web scraping (BeautifulSoup, Selenium)

Data engineering

Automation

Data cleaning and normalization

Cloud infrastructure (AWS)

LLM frameworks

Javascript content handling

English proficiency (Upper-intermediate B2)

Education

Bachelor's or Master's Degree in Engineering, Applied Mathematics, Computer Science

Tools

Apify

OpenRouter

Docker

Job description

Mindrift is seeking a highly skilled Senior Python Data Scraping Engineer for the Tendem project. This part-time remote role involves driving specialized data scraping workflows.

As an AI Pilot, you will collaborate with Tendem Agents, providing quality control and domain expertise to ensure accurate data results. Candidates should have at least 5 years of experience in web scraping and strong skills in Python, with the ability to handle dynamic content and data cleaning.

The compensation for this role can reach up to $45 per hour, depending on contributions.