Scraping Tech Lead (Web scraping & Anti-bot)

Infatica.io; España; A distancia; EUR 70.000 - 100.000; Jornada completa

Descripción de la vacante

A leading proxy solutions provider in Spain is seeking an experienced Tech Lead for their web scraping development team. You will be responsible for technical leadership, architectural decisions, and building a high-performance scraping platform. The ideal candidate has extensive scraping and engineering experience, strong DevOps skills, and fluent English. This role offers a competitive compensation package and remote work flexibility.

Servicios

Demonstrate influence on architecture and team decisions

Budget for conferences and courses

Competitive compensation package

Remote work flexibility

Formación

• 5+ years of engineering experience in high-load backend/data platforms.
• Experience with async Python and Go (ideally both), Redis, message brokers.
• Decision-making skills and mentoring abilities.

Responsabilidades

• Lead the web scraping development team and drive architectural decisions.
• Establish development and release processes.
• Participate in hiring backend, DevOps, and QA engineers.

Conocimientos

Scraping experience

Engineering in high-load data platforms

Understanding of HTTP/TLS/HTTP2

Async Python and Go

Advanced DevOps tools

Bypassing bot protection systems

Fluent English

Herramientas

Kubernetes

Prometheus

CI/CD

Descripción del empleo

Overview

Infatica.io is a global provider of proxy and DaaS solutions. We're building our own high-load web scraping platform : an API where you can submit any URL and receive clean HTML or structured JSON output, without worrying about proxies, CAPTCHAs, or anti-bot systems.

The platform will support both cloud deployment and on-premises deployment in client infrastructure (on-prem, Kubernetes).

We are now looking for an experienced Tech Lead for our web scraping development team who will lead the team, become the technical leader of the platform, drive architectural decisions, and shape the future of our cutting-edge scraping infrastructure.

Key Responsibilities

Architecture Design

• Data-plane : high-parallel crawler, session management, anti-bot bypass, CAPTCHA solver
• Control-plane : API, authorization, billing, quotas, monitoring
• Infrastructure : microservices, Docker / K8s, CI / CD, observability

Development Leadership

• Team building : participate in hiring backend, browser, DevOps, and QA engineers
• Establish development and release processes
• Code quality control and technical decision oversight

Anti-Bot Research & Bypass

• Browser and network-level fingerprinting (JA3, TLS, CDP)
• Protection bypass : Cloudflare, Akamai, Qrator, ServicePipe, Variti, and others

DevOps / SRE

• CI / CD setup, Helm charts, scaling configuration
• Monitoring organization (Prometheus, Grafana, Loki) and SLA processes

Requirements

• Extensive Scraping experience (mandatory)
• 5+ years of engineering experience in high-load backend / data platforms
• Excellent understanding of HTTP, TLS, HTTP / 2, proxies, browser stack (CDP, WebRTC)
• Experience with async Python and Go (ideally both), Redis, queues, message brokers
• Advanced level DevOps tools : Kubernetes, Helm, Prometheus, CI / CD
• Experience analyzing and bypassing bot protection systems — strong plus
• Fluent English (all documentation and part of the team are English-speaking)
• Decision-making skills, mentoring abilities, and accountability for results

Benefits

• Participate in developing the company's key product from scratch
• High autonomy and influence on architecture and team decisions
• Budget for conferences, courses, and work tools
• Competitive compensation package
• Remote work flexibility

Join us

This is a unique opportunity to build a world-class product from the ground up and establish yourself as a key technical decision-maker in a rapidly growing company.

Apply now and become the technical leader who shapes our platform's future!