Remote Senior Python Data Scraping Engineer

Mindrift; Poland; On-site; PLN 166,036 - 236,476; Part time

Job summary

Mindrift is seeking a highly skilled Senior Python Data Scraping Engineer for the Tendem project, emphasizing data scraping workflows within a hybrid AI + human system. This part-time remote role requires expertise in web scraping, automation, and data processing.

The ideal candidate will collaborate with Tendem Agents, utilizing tools like Apify and OpenRouter for effective data extraction and validation. Strong attention to detail and a methodical approach are essential.

Compensation is up to $40 per hour depending on contribution level. Work is estimated at 10-20 hours per week during active phases of the project.

Qualifications

• 5+ years of experience in data engineering, web scraping, or software development.
• Strong technical foundation with scripting and automation experience.
• Experience handling anti-bot mechanisms and dynamic site structures.

Responsibilities

• Own end-to-end data extraction workflows across complex websites.
• Leverage internal tools to accelerate data collection and validation.
• Ensure reliable extraction from dynamic web sources.

Skills

Python web scraping (BeautifulSoup, Selenium)

Data extraction and processing

Automation

Data cleaning and normalization

Cloud infrastructure (AWS)

LLM frameworks (LangChain, OpenRouter)

Education

Bachelor’s or Master’s Degree in Engineering, Applied Mathematics, Computer Science

Tools

Apify

OpenRouter

Docker

Job description

Mindrift is seeking a highly skilled Senior Python Data Scraping Engineer for the Tendem project, emphasizing data scraping workflows within a hybrid AI + human system. This part-time remote role requires expertise in web scraping, automation, and data processing.

The ideal candidate will collaborate with Tendem Agents, utilizing tools like Apify and OpenRouter for effective data extraction and validation. Strong attention to detail and a methodical approach are essential.

Compensation is up to $40 per hour depending on contribution level. Work is estimated at 10-20 hours per week during active phases of the project.