Senior Python Scraping Engineer

Harnham; Remote; GBP 60,000 - 70,000; Full time

Job summary

A leading AI-focused data team is seeking a Senior Python Scraping Engineer to design and maintain production web scrapers. This fully remote role requires expertise in tackling advanced anti-bot systems, browser automation, and managing large datasets. The ideal candidate will have strong Python skills, experience with scraping, and the ability to collaborate effectively with AI and data teams. A competitive salary of £60,000 – £70,000 is offered, reflecting the candidate's experience and skills.

Qualifications

• Strong Python-based scraping experience with production, large-scale focus.
• Deep understanding of anti-bot detection and evasion techniques.
• Hands-on experience with tools for browser automation.

Responsibilities

• Design, build, and maintain large-scale production web scrapers.
• Tackle advanced anti-bot and detection systems.
• Collaborate with data engineers and AI teams.

Skills

Python-based scraping experience

Anti-bot detection & evasion

Browser fingerprinting

CAPTCHA solving

Proxy and IP management

HTTP protocols and browser networking

Browser automation tools (Playwright, Selenium, Puppeteer)

Debugging complex scraping failures

Job description

Senior Python Scraping Engineer

Location: Fully remote

Salary: £60,000 – £70,000

The Opportunity

I'm looking for a Python Scraping Engineer to join a growing AI-focused data team.

What You’ll Do

• Design, build, and maintain large-scale production web scrapers
• Tackle advanced anti-bot and detection systems
• Work with browser automation and dynamic, JavaScript-heavy sites
• Improve scraper reliability, throughput, and data quality
• Collaborate closely with data engineers and AI teams to ensure scraped data is trusted and usable

What We’re Looking For

• Strong Python-based scraping experience (production, large-scale)
• Deep knowledge of:
• Anti-bot detection & evasion
• Browser fingerprinting
• CAPTCHA solving
• Proxy and IP management
• HTTP protocols and browser networking
• Hands-on experience with browser automation tools (e.g. Playwright, Selenium, Puppeteer)
• Comfortable debugging complex scraping failures at scale

Tech Preferences

• Python (preferred)

Interview Process

1. CTO interview
2. Meet the team