Part-Time Remote Senior Python Data Scraping Engineer (AI)

Mindrift; New York (NY); Remote; USD 51,143 - 72,840; Part time

Job summary

Mindrift is seeking a highly skilled Senior Python Data Scraping Engineer for the Tendem project to drive specialized data scraping workflows. This part-time remote opportunity requires hands-on experience in web scraping and data extraction.

You will be responsible for end-to-end data extraction workflows, utilizing internal tools and custom approaches to ensure accuracy and reliability. Ideal candidates will have a strong technical background and experience in handling dynamic web sources.

Qualifications

• 5+ years of experience in data engineering, web scraping, automation, or software development.
• Strong technical foundation with practical experience in scripting and automation.
• Experience handling anti-bot mechanisms and dynamic site structures.

Responsibilities

• Own end-to-end data extraction workflows across complex websites.
• Leverage internal tools alongside custom workflows for data collection.
• Ensure reliable extraction from dynamic and interactive web sources.

Skills

Python web scraping (BeautifulSoup, Selenium)

Data cleaning and validation

Cloud infrastructure (AWS)

Containerization (Docker)

Experience with LLM frameworks

Troubleshooting independently

Education

Bachelor’s or Master’s Degree in Engineering, Applied Mathematics, Computer Science

Tools

GitHub

Apify

OpenRouter

Job description

Mindrift is seeking a highly skilled Senior Python Data Scraping Engineer for the Tendem project to drive specialized data scraping workflows. This part-time remote opportunity requires hands-on experience in web scraping and data extraction.

You will be responsible for end-to-end data extraction workflows, utilizing internal tools and custom approaches to ensure accuracy and reliability. Ideal candidates will have a strong technical background and experience in handling dynamic web sources.