Senior Python Data Scraping Engineer - Remote AI Pilot

Advanced Search; Kuwait City; On-site; KWD 9,300 - 16,000; Part time

Benefits offered by this job

Remote freelance project

Job summary

Mindrift is seeking senior Python data scraping engineers to join the Tendem project on a part-time remote basis. You will craft end-to-end scraping workflows, validate outputs, and collaborate with Tendem agents to deliver accurate datasets.

The role focuses on web extraction, handling dynamic sites, API access via proxies, and using Apify/OpenRouter alongside your own scripts. Prior experience with AWS, Docker, and LLM-assisted automation is highly valued.

Qualifications

• 5+ years in data engineering, web scraping, automation, or software development.
• Bachelor’s or Master’s in engineering, applied mathematics, computer science, or related field is a plus.
• Strong scripting and AI-assisted workflow experience; ability to work with LLMs independently.

Responsibilities

• Own end-to-end data extraction workflows across complex websites with accurate, structured outputs.
• Leverage Apify and OpenRouter with custom workflows to speed data collection and validation.
• Enforce data quality through validation checks and cross-source consistency.
• Scale scraping operations, monitor failures, and adapt to site structure changes.

Skills

Python

Web scraping

BeautifulSoup

Selenium

Dynamic content handling

APIs via proxies

AWS

Docker

LangChain

OpenRouter

GitHub

LLM workflows

Independent work

Education

Bachelor’s or Master’s in engineering / CS

Tools

Apify

OpenRouter

Docker

AWS

Selenium

BeautifulSoup

LangChain

Job description

Mindrift is seeking senior Python data scraping engineers to join the Tendem project on a part-time remote basis. You will craft end-to-end scraping workflows, validate outputs, and collaborate with Tendem agents to deliver accurate datasets.

The role focuses on web extraction, handling dynamic sites, API access via proxies, and using Apify/OpenRouter alongside your own scripts. Prior experience with AWS, Docker, and LLM-assisted automation is highly valued.