Senior Python Scraping Engineer

Harnham; Remote; GBP 60,000 - 70,000; Full time

Job summary

A leading data company seeks a Senior Python Scraping Engineer to design and maintain large-scale production web scrapers. The ideal candidate will tackle challenges with anti-bot systems and collaborate with data engineers and AI teams to ensure the usability of scraped data. Strong Python experience and knowledge of anti-bot techniques are essential for success in this role, which offers a fully remote work model and competitive salary range of £60,000 to £70,000.

Qualifications

• Strong Python-based scraping experience (production, large-scale).
• Deep knowledge of anti-bot detection & evasion.
• Hands-on experience with browser automation tools (e.g., Playwright, Selenium, Puppeteer).

Responsibilities

• Design, build, and maintain large-scale production web scrapers.
• Tackle advanced anti-bot and detection systems.
• Collaborate closely with data engineers and AI teams.

Job description

Senior Python Scraping Engineer

Location: Fully remote

Salary: £60,000 – £70,000

The Opportunity

I'm looking for a Python Scraping Engineer to join a growing AI-focused data team.

What You’ll Do

• Design, build, and maintain large-scale production web scrapers
• Tackle advanced anti-bot and detection systems
• Work with browser automation and dynamic, JavaScript-heavy sites
• Improve scraper reliability, throughput, and data quality
• Collaborate closely with data engineers and AI teams to ensure scraped data is trusted and usable

What We’re Looking For

• Strong Python-based scraping experience (production, large-scale)
• Deep knowledge of:
• Anti-bot detection & evasion
• Browser fingerprinting
• CAPTCHA solving
• Proxy and IP management
• HTTP protocols and browser networking
• Hands-on experience with browser automation tools (e.g. Playwright, Selenium, Puppeteer)
• Comfortable debugging complex scraping failures at scale

Tech Preferences

• Python (preferred)

Interview Process

1. CTO interview
2. Meet the team