Remote Senior Python Data Scraping Engineer

Mindrift; Glasgow; On-site; GBP 30,784 - 61,568; Part time

Job summary

Mindrift in Glasgow is seeking a Senior Python Data Scraping Engineer to drive data scraping workflows for the Tendem project. This part-time remote role requires expertise in web scraping and data processing, fostering collaboration with AI and human components.

Ideal candidates will have over 5 years of experience, proficiency in Python scraping tools, and a detail-oriented approach to data accuracy. Compensation is up to $45 per hour based on contributions.

Qualifications

• 5+ years of experience in data engineering, web scraping, automation, or software development.
• Ability to solve non-trivial problems and work with LLMs.
• Experience handling complex data structures and anti-bot mechanisms.

Responsibilities

• Own end-to-end data extraction workflows across complex websites.
• Ensure reliable extraction from dynamic and interactive web sources.
• Enforce data quality standards through validation checks.

Skills

Python web scraping (BeautifulSoup, Selenium)

Data engineering

Automation

Data cleaning and validation

Experience with LLM frameworks

Cloud infrastructure (AWS)

Dynamic site handling

Education

Bachelor's or Master's Degree in Engineering, Applied Mathematics, Computer Science

Tools

Apify

OpenRouter

Docker

Job description

Mindrift in Glasgow is seeking a Senior Python Data Scraping Engineer to drive data scraping workflows for the Tendem project. This part-time remote role requires expertise in web scraping and data processing, fostering collaboration with AI and human components.

Ideal candidates will have over 5 years of experience, proficiency in Python scraping tools, and a detail-oriented approach to data accuracy. Compensation is up to $45 per hour based on contributions.