Senior Scraper Engineer: Scalable Data Extraction&Anti-Bot

amIT Global Solutions Sdn Bhd

Indonesia

On-site

IDR 350,000,000 - 550,000,000

Full time

8 days ago

Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Job summary

amIT Global Solutions Sdn Bhd in Indonesia is seeking a senior Python scraping engineer to design, build, and maintain scalable scraping systems using requests, BeautifulSoup, Selenium, Playwright, and Scrapy. You will focus on reliability and maintainability, not one-off scripts.

You will architect anti-detection strategies, rotate proxies, bypass CAPTCHAs, and perform mobile app data extraction. You will own data pipelines ingesting web, mobile, and API data, and mentor junior engineers while

Qualifications

Bachelor's degree in Computer Science, Information Systems, or related field.
5+ years in web scraping, crawling, or automation scripting with at least 1–2 years designing scalable scraping systems.
Strong proficiency in Python and scraping ecosystem tools.
Hands-on experience with mobile scraping/reverse engineering and anti-detection measures.

Responsibilities

Design, build, and maintain scalable Python-based scraping systems using requests, BeautifulSoup, Selenium, Playwright, Scrapy.
Architect anti-detection strategies, rotating proxies, CAPTCHA-bypass, and fingerprint randomization.
Reverse-engineer and extract data from mobile apps via API interception and tooling.
Architect data pipelines ingesting web, mobile, HTML/JSON/XML sources.
Own orchestration and scheduling of scraping workflows (Airflow, Prefect, n8n).
Lead integration of pipelines into Snowflake, S3, GCS, Google Sheets, SharePoint.
Establish monitoring, logging, and observability for scraping infrastructure.
Mentor junior engineers and evaluate build-vs-buy options for targets and tooling.