Senior Python Scraping Engineer

Harnham; Remote; GBP 60,000 - 70,000; Full time

Job summary

A leading data-focused firm is seeking a Senior Python Scraping Engineer to join their remote AI-focused data team. You will design and maintain large-scale web scrapers, tackle advanced anti-bot systems, and work closely with other engineers to ensure data quality. The ideal candidate will have strong experience with Python-based scraping, browser automation tools, and a deep understanding of anti-bot evasion techniques. This is an exciting opportunity to contribute to a growing team focused on leveraging AI for data solutions.

Qualifications

• Strong Python-based scraping experience in production settings.
• Deep knowledge of anti-bot detection and evasion techniques.
• Experience with browser automation tools like Playwright or Selenium.

Responsibilities

• Design, build, and maintain large-scale production web scrapers.
• Tackle advanced anti-bot and detection systems.
• Collaborate closely with data engineers and AI teams.

Skills

Python-based scraping experience

Anti-bot detection & evasion

Browser fingerprinting

CAPTCHA solving

Proxy and IP management

HTTP protocols and browser networking

Browser automation tools (e.g. Playwright, Selenium, Puppeteer)

Job description

Senior Python Scraping Engineer

Location: Fully remote

Salary: £60,000 – £70,000

The Opportunity

I'm looking for a Python Scraping Engineer to join a growing AI-focused data team.

What You’ll Do

• Design, build, and maintain large-scale production web scrapers
• Tackle advanced anti-bot and detection systems
• Work with browser automation and dynamic, JavaScript-heavy sites
• Improve scraper reliability, throughput, and data quality
• Collaborate closely with data engineers and AI teams to ensure scraped data is trusted and usable

What We’re Looking For

• Strong Python-based scraping experience (production, large-scale)
• Deep knowledge of:
• Anti-bot detection & evasion
• Browser fingerprinting
• CAPTCHA solving
• Proxy and IP management
• HTTP protocols and browser networking
• Hands-on experience with browser automation tools (e.g. Playwright, Selenium, Puppeteer)
• Comfortable debugging complex scraping failures at scale

Tech Preferences

• Python (preferred)

Interview Process

1. CTO interview
2. Meet the team