Remote Senior Python Data Scraping Engineer | AI Pilot

Apply on the Job Website

Bahrain

On-site

BHD 11,000 - 19,000

Part time

6 days ago

Be an early applicant

Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Job summary

Mindrift is seeking a senior Python data scraping engineer to join the Tendem project and drive specialized scraping workflows within our hybrid AI + human system. This freelance, part-time remote role emphasizes data extraction, quality control, and delivering structured datasets.

You'll collaborate with Tendem agents, tackle web extraction across complex sites, handle anti-bot measures, and apply tools like Apify and OpenRouter while leveraging your scripting and AI-assisted workflows to

Qualifications

5+ years of data engineering, web scraping, automation, or software development experience.
Bachelor’s or Master’s in engineering, CS, or related fields is a plus.
Strong scripting, automation, and AI-assisted workflows; able to work independently.
Proficient in Python web scraping (BeautifulSoup, Selenium) with dynamic content.
Experience extracting data from complex structures and validating datasets (CSV/JSON).
Experience handling anti-bot measures and anti-detection techniques.
Familiar with cloud (AWS) and Docker; hands-on with LLM frameworks (LangChain/OpenRouter).
English proficiency: Upper-intermediate (B2) or above.

Responsibilities

Own end-to-end data extraction workflows across complex websites.
Use Apify and OpenRouter along with custom workflows to collect and validate data.
Ensure data quality with validation checks and formatting standards.
Scale scraping operations and monitor for site structure changes.
Work with Tendem agents to deliver accurate structured datasets.