Scraping Tech Lead Engineer (Web scraping & Anti-bot)

Infatica.io; United Kingdom; Remote; GBP 80,000 - 110,000; Full time

Job summary

A leading global provider of proxy solutions is seeking an experienced Tech Lead to oversee their web scraping development team. The ideal candidate should have extensive experience in scraping, a strong background in backend engineering, and proficiency in Python and Go. This role offers high autonomy in architecture decisions and the opportunity to shape the platform's future while enjoying remote work flexibility. Competitive compensation is part of the offer.

Benefits

Budget for conferences

Competitive compensation package

Remote work flexibility

Work tools budget

Qualifications

• 5+ years of engineering experience in high-load backend/data platforms.
• Extensive scraping experience is mandatory.
• Experience analyzing and bypassing bot protection systems is a strong plus.
• Fluent English is required.

Responsibilities

• Lead the web scraping development team.
• Drive architectural decisions for the platform.
• Participate in hiring engineers for various roles.
• Establish development and release processes.

Skills

Scraping experience

HTTP knowledge

Async Python and Go

DevOps tools knowledge

Decision-making skills

Mentoring abilities

Fluent English

Tools

Kubernetes

Helm

Prometheus

Job description

Overview

Infatica.io is a global provider of proxy and DaaS solutions. We're building our own high-load web scraping platform: an API where you can submit any URL and receive clean HTML or structured JSON output, without worrying about proxies, CAPTCHAs, or anti-bot systems.

The platform will support both cloud deployment and on-premises deployment in client infrastructure (on-prem, Kubernetes).

We are now looking for an experienced Tech Lead for our web scraping development team who will lead the team, become the technical leader of the platform, drive architectural decisions, and shape the future of our cutting-edge scraping infrastructure.

Key Responsibilities

Architecture Design

• Data-plane: high-parallel crawler, session management, anti-bot bypass, CAPTCHA solver
• Control-plane: API, authorization, billing, quotas, monitoring
• Infrastructure: microservices, Docker/K8s, CI/CD, observability

Development Leadership

• Team building: participate in hiring backend, browser, DevOps, and QA engineers
• Establish development and release processes
• Code quality control and technical decision oversight

Anti-Bot Research & Bypass

• Browser and network-level fingerprinting (JA3, TLS, CDP)
• Protection bypass: Cloudflare, Akamai, Qrator, ServicePipe, Variti, and others

DevOps / SRE

• CI/CD setup, Helm charts, scaling configuration
• Monitoring organization (Prometheus, Grafana, Loki) and SLA processes

Requirements

• 5+ years of engineering experience in high-load backend/data platforms
• Extensive Scraping experience (mandatory)
• Excellent understanding of HTTP, TLS, HTTP/2, proxies, browser stack (CDP, WebRTC)
• Experience with async Python and Go (ideally both), Redis, queues, message brokers
• Advanced level DevOps tools: Kubernetes, Helm, Prometheus, CI/CD
• Experience analyzing and bypassing bot protection systems - strong plus
• Fluent English (all documentation and part of the team are English-speaking)
• Decision-making skills, mentoring abilities, and accountability for results

Benefits

What We Offer

• Participate in developing the company's key product from scratch
• High autonomy and influence on architecture and team decisions
• Budget for conferences, courses, and work tools
• Competitive compensation package
• Remote work flexibility

Join us

This is a unique opportunity to build a world-class product from the ground up and establish yourself as a key technical decision-maker in a rapidly growing company.

Apply now and become the technical leader who shapes our platform's future!