Engineering Manager (Web Scraping)

MrScraper; Kota Bandung; On-site; USD 60.000 - 100.000; Full time

Job summary

A leading company in tech solutions is seeking an Engineering Manager for their web scraping division in Bandung. This role involves leading a team of engineers, designing scraping infrastructures, and ensuring compliance with relevant laws. Ideal candidates will possess strong coding skills and experience in various database technologies. Join an innovative team with a competitive salary and performance bonuses, giving you international exposure and opportunities for personal growth.

Benefits

Very competitive salary - above market

International exposure working with clients

Performance bonus

Offsite vacation

Qualifications

• Experience with browsers and rotating proxies.
• Knowledge of cloud services and containerization tools.
• Relevant work experience in the field.

Responsibilities

• Lead and mentor a team of web scraping engineers.
• Architect and maintain scalable scraping infrastructures.
• Design and implement robust scraping strategies.

Skills

Web Scraping

Proactive mindset

Outstanding coding skills

Tools

PostgreSQL

MongoDB

Kafka

RabbitMQ

AWS

GCP

Azure

Docker

Kubernetes

Job description

Engineering Manager (Web Scraping)

Key Responsibilities:

• Lead and mentor a team of web scraping engineers.
• Architect and maintain scalable scraping infrastructures and pipelines.
• Oversee task delegation, code reviews, and team performance.
• Design and implement robust scraping strategies to handle rate-limiting, CAPTCHAs, dynamic content, and JavaScript-heavy websites.
• Ensure compliance with data protection laws and website terms of service.
• Collaborate with data analysts, product managers, and other engineering teams to define scraping requirements and deliver accurate data.
• Monitor system performance and address technical issues proactively.
• Stay up to date with the latest scraping tools, technologies, and best practices.

Requirements:

• Experience with browsers, rotating proxies, and solving anti-bot challenges.
• Knowledge of database technologies (e.g., PostgreSQL, MongoDB) and message queues (e.g., Kafka, RabbitMQ).
• Familiarity with cloud services (AWS, GCP, or Azure) and containerization tools (Docker, Kubernetes).
• Can join immediately.
• Relevant work experience in the field.
• Willing to ship fast.
• Proactive and action-oriented mindset.
• Outstanding coding skills.
• Not engaged in other part-time, freelance, or full-time jobs.
• Willing to work full on-site (WFO) in Bandung.
• Preferably motivated and proactive, not passive.

What you will get?

• Very competitive salary - above market.
• International exposure working with international clients.
• Performance bonus.
• Offsite vacation.

Interested? Send your CV and desired salary to [e-mail] with the subject “Engineering Manager - Name”. Applications without this subject line will not be considered.