Senior Python Scraping Engineer

Harnham; Remote; GBP 60,000 - 70,000; Full time

Job summary

A leading data consultancy is seeking a Senior Python Scraping Engineer to join its AI-focused data team. This remote role requires expertise in Python for building and maintaining large-scale web scrapers, tackling anti-bot systems, and ensuring reliable data quality. Ideal candidates will have strong Python scraping experience, knowledge of CAPTCHA solving, and hands-on experience with browser automation tools. This position offers competitive salary and a unique opportunity to work closely with engineers and AI teams.

Qualifications

• Strong Python-based scraping experience
• Deep knowledge of anti-bot detection & evasion
• Experience with browser automation tools like Playwright, Selenium, Puppeteer

Responsibilities

• Design, build, and maintain large-scale production web scrapers
• Tackle advanced anti-bot and detection systems
• Collaborate closely with data engineers and AI teams

Job description

Senior Python Scraping Engineer

Location: Fully remote

Salary: £60,000 – £70,000

The Opportunity

I'm looking for a Python Scraping Engineer to join a growing AI-focused data team.

What You’ll Do

• Design, build, and maintain large-scale production web scrapers
• Tackle advanced anti-bot and detection systems
• Work with browser automation and dynamic, JavaScript-heavy sites
• Improve scraper reliability, throughput, and data quality
• Collaborate closely with data engineers and AI teams to ensure scraped data is trusted and usable

What We’re Looking For

• Strong Python-based scraping experience (production, large-scale)
• Deep knowledge of:
• Anti-bot detection & evasion
• Browser fingerprinting
• CAPTCHA solving
• Proxy and IP management
• HTTP protocols and browser networking
• Hands-on experience with browser automation tools (e.g. Playwright, Selenium, Puppeteer)
• Comfortable debugging complex scraping failures at scale

Tech Preferences

• Python (preferred)

Interview Process

1. CTO interview
2. Meet the team