Scraping Tech Lead Engineer (Web Scraping & Anti-Bot)

Infatica.Io; Remote; ZAR 700 000 - 900 000; Full time

Job summary

A global technology provider is seeking a Scraping Tech Lead Engineer to design and develop a high-load web scraping platform. The role requires extensive scraping experience, strong knowledge of backend systems, and leadership skills. You will influence architecture and team decisions, work remotely, and enjoy a competitive compensation package. Fluency in English is required, and you will lead efforts to bypass bot protection systems while managing development and operational processes.

Benefits

Competitive compensation package

Budget for conferences and courses

Remote work flexibility

Qualifications

• 5+ years of engineering experience in high-load backend/data platforms.
• Extensive scraping experience is mandatory.
• Excellent understanding of HTTP, TLS, HTTP/2, proxies, and browser stack.
• Experience with async Python and Go.
• Fluent English in documentation and communication.

Responsibilities

• Design architecture for high-load web scraping and anti-bot solutions.
• Lead development teams and establish release processes.
• Research and implement anti-bot bypass techniques.
• Organize monitoring processes to ensure performance.

Skills

Backend engineering

Web scraping

DevOps practices

Python

Go

Cloudflare bypass

Tools

Docker

Kubernetes

Helm

Prometheus

Grafana

Job description

Scraping Tech Lead Engineer (Web scraping & Anti-bot)

Infatica.io is a global provider of proxy and DaaS solutions.

We're building our own high-load web scraping platform : an API where you can submit any URL and receive clean HTML or structured JSON output, without worrying about proxies, CAPTCHAs, or anti-bot systems.

The platform supports both cloud deployment and on-premises deployment in client infrastructure (on-prem, Kubernetes).

Key Responsibilities

Architecture Design :

• Data-plane : high-parallel crawler, session management, anti-bot bypass, CAPTCHA solver
• Control-plane : API, authorization, billing, quotas, monitoring
• Infrastructure : microservices, Docker / K8s, CI / CD, observability

Development Leadership :

• Team building : participate in hiring backend, browser, DevOps, and QA engineers
• Establish development and release processes
• Code quality control and technical decision oversight

Anti-Bot Research & Bypass :

• Browser and network-level fingerprinting (JA3, TLS, CDP)
• Protection bypass : Cloudflare, Akamai, Qrator, ServicePipe, Variti, and others

DevOps / SRE :

• CI / CD setup, Helm charts, scaling configuration
• Monitoring organization (Prometheus, Grafana, Loki) and SLA processes

Requirements

5+ years of engineering experience in high-load backend / data platforms

Extensive scraping experience (mandatory)

Excellent understanding of HTTP, TLS, HTTP / 2, proxies, and browser stack (CDP, WebRTC)

Experience with async Python and Go (ideally both), Redis, queues, message brokers

Advanced level DevOps tools : Kubernetes, Helm, Prometheus, CI / CD

Experience analyzing and bypassing bot protection systems – strong plus

Fluent English (all documentation and part of the team are English-speaking)

Decision-making skills, mentoring abilities, and accountability for results

Benefits

Participate in developing the company's key product from scratch

High autonomy and influence on architecture and team decisions

Budget for conferences, courses, and work tools

Competitive compensation package

Remote work flexibility

Apply now and become the technical leader who shapes our platform's future!

#J Ljbffr