Senior Python Web Scraping Engineer at Scale

Tenth Revolution Group; Remote; GBP 70,000 - 90,000; Full time

Job summary

A leading tech company in the UK is seeking a Senior Python Scraping Engineer to design and maintain large-scale scraping systems, particularly focused on Google. The ideal candidate has strong Python experience, a deep understanding of scraping protected platforms, and excellent skills in handling complex scraping challenges. This role offers the opportunity to work with advanced AI tools while ensuring data accuracy and usability. The position is perfect for those passionate about innovative coding practices in an agile environment.

Qualifications

• Strong professional experience with Python and production-grade scraping.
• Experience scraping Google or similarly protected platforms.
• Solid understanding of HTTP, TLS, cookies, and networking behavior.
• Comfortable handling rate limiting and bot detection systems.
• Experience with cloud environments and running scraping systems at scale.

Responsibilities

• Design, build, and maintain large-scale Python scraping systems.
• Develop scrapers for dynamic pages using browser automation.
• Engineer robust extraction pipelines prioritizing data accuracy.
• Monitor scrape health and debug production issues promptly.
• Collaborate with teams to ensure usability of scraped data.

Skills

Python

Scraping techniques

HTTP fundamentals

Browser automation

Data extraction methods

Asynchronous programming

Debugging skills

Tools

Playwright

Selenium

Puppeteer

Job description

A leading tech company in the UK is seeking a Senior Python Scraping Engineer to design and maintain large-scale scraping systems, particularly focused on Google. The ideal candidate has strong Python experience, a deep understanding of scraping protected platforms, and excellent skills in handling complex scraping challenges. This role offers the opportunity to work with advanced AI tools while ensuring data accuracy and usability. The position is perfect for those passionate about innovative coding practices in an agile environment.