Remote Tech Lead: Web Scraping & Anti-Bot Platform

Infatica.Io; Remote; ZAR 900 000 - 1 200 000; Full time

Job summary

A global technology firm in Gauteng is seeking a Scraping Tech Lead Engineer to design and lead the development of a high-load web scraping platform. This role involves architecture design, research on anti-bot techniques, and leading a backend team. Candidates should have extensive experience in web scraping, backend engineering, and appropriate tools like Kubernetes and Prometheus. This position offers a competitive salary and remote work flexibility, allowing significant influence on the product's development.

Benefits

Competitive compensation package

Remote work flexibility

Budget for conferences and courses

Qualifications

• 5+ years of engineering experience in high-load backend/data platforms.
• Extensive scraping experience is mandatory.
• Fluent in English for documentation and team communication.
• Experience with async Python and Go is preferred.

Responsibilities

• Design architecture for high-parallel crawlers and API.
• Lead development processes for the backend team.
• Research and implement anti-bot solutions.
• Set up CI/CD processes and monitor deployments.

Skills

High-load backend engineering

Web scraping

HTTP, TLS, HTTP/2

Async Python

Go

Kubernetes

Prometheus

DevOps tools

Tools

Redis

Docker

Grafana

Loki

Job description

A global technology firm in Gauteng is seeking a Scraping Tech Lead Engineer to design and lead the development of a high-load web scraping platform. This role involves architecture design, research on anti-bot techniques, and leading a backend team. Candidates should have extensive experience in web scraping, backend engineering, and appropriate tools like Kubernetes and Prometheus. This position offers a competitive salary and remote work flexibility, allowing significant influence on the product's development.