Senior Python Scraping Engineer

Harnham; Remote; GBP 60,000 - 70,000; Full time

Job summary

A leading AI-focused data firm is seeking a Senior Python Scraping Engineer to join their remote team. The role involves designing and maintaining large-scale web scrapers, tackling advanced anti-bot challenges, and collaborating closely with data engineers to enhance data quality. Ideal candidates will have strong Python scraping experience, knowledge of anti-bot technologies, and proficiency with automation tools. This position offers a competitive salary range of £60,000 to £70,000.

Qualifications

• Strong Python-based scraping experience, especially in production and at scale.
• Deep knowledge of anti-bot detection, browser fingerprinting, and CAPTCHA solving.
• Hands-on experience with browser automation tools like Playwright or Selenium.

Responsibilities

• Design and maintain large-scale production web scrapers.
• Tackle advanced anti-bot and detection systems.
• Collaborate with data engineers and AI teams to ensure data usability.

Skills

Python-based scraping experience

Anti-bot detection & evasion

Browser fingerprinting

CAPTCHA solving

Proxy and IP management

HTTP protocols and browser networking

Browser automation tools (e.g. Playwright, Selenium, Puppeteer)

Job description

Senior Python Scraping Engineer

Location: Fully remote

Salary: £60,000 – £70,000

The Opportunity

I'm looking for a Python Scraping Engineer to join a growing AI-focused data team.

What You’ll Do

• Design, build, and maintain large-scale production web scrapers
• Tackle advanced anti-bot and detection systems
• Work with browser automation and dynamic, JavaScript-heavy sites
• Improve scraper reliability, throughput, and data quality
• Collaborate closely with data engineers and AI teams to ensure scraped data is trusted and usable

What We’re Looking For

• Strong Python-based scraping experience (production, large-scale)
• Deep knowledge of:
• Anti-bot detection & evasion
• Browser fingerprinting
• CAPTCHA solving
• Proxy and IP management
• HTTP protocols and browser networking
• Hands-on experience with browser automation tools (e.g. Playwright, Selenium, Puppeteer)
• Comfortable debugging complex scraping failures at scale

Tech Preferences

• Python (preferred)

Interview Process

1. CTO interview
2. Meet the team