Python Scraping Engineer

Harnham; Remote; GBP 40,000 - 60,000; Full time

Job summary

A leading data-focused technology firm is seeking a Python Scraping Engineer to enhance their AI-driven data team. This role involves designing and maintaining large-scale web scrapers, addressing advanced anti-bot systems, and improving data quality. The ideal candidate should have extensive experience with Python scraping, including handling browser automation tools like Playwright and Selenium. This position is fully remote, offering a competitive salary of £40,000 to £60,000.

Responsibilities

• Design, build, and maintain large-scale production web scrapers.
• Tackle advanced anti-bot and detection systems.
• Work with browser automation and dynamic, JavaScript-heavy sites.
• Improve scraper reliability, throughput, and data quality.
• Collaborate closely with data engineers and AI teams.

Skills

Python-based scraping experience

Anti-bot detection & evasion

Browser fingerprinting

CAPTCHA solving

Proxy and IP management

HTTP protocols and browser networking

Browser automation tools

Debugging complex scraping failures

Tools

Playwright

Selenium

Puppeteer

Job description

Overview

Python Scraping Engineer

Location: Fully remote

Salary: £40,000 – £60,000

The Opportunity

I'm looking for a Python Scraping Engineer to join a growing AI-focused data team.

Responsibilities

• Design, build, and maintain large-scale production web scrapers
• Tackle advanced anti-bot and detection systems
• Work with browser automation and dynamic, JavaScript-heavy sites
• Improve scraper reliability, throughput, and data quality
• Collaborate closely with data engineers and AI teams to ensure scraped data is trusted and usable

Qualifications

• Strong Python-based scraping experience (production, large-scale)
• Anti-bot detection & evasion
• Browser fingerprinting
• CAPTCHA solving
• Proxy and IP management
• HTTP protocols and browser networking
• Hands-on experience with browser automation tools (e.g. Playwright, Selenium, Puppeteer)
• Comfortable debugging complex scraping failures at scale

Tech Preferences

• Python (preferred)

Interview Process

1. CTO interview
2. Meet the team