Senior Python Scraping Engineer

Harnham; Glasgow; On-site; GBP 60,000 - 70,000; Full time

Job summary

A leading AI-focused data firm is seeking a Senior Python Scraping Engineer to design and maintain large-scale web scrapers. You will tackle advanced anti-bot systems and collaborate closely with data engineers. Ideal candidates have strong Python scraping experience and deep knowledge of anti-bot detection. This fully remote position offers a salary between £60,000 and £70,000, along with the opportunity to work with an innovative data team.

Qualifications

• Strong experience in production, large-scale Python scraping.
• Deep knowledge of anti-bot detection and browser fingerprinting.
• Hands-on with browser automation tools like Playwright or Selenium.

Responsibilities

• Design, build, and maintain large-scale production web scrapers.
• Tackle advanced anti-bot and detection systems.
• Collaborate with data engineers and AI teams.

Skills

Python-based scraping experience

Anti-bot detection & evasion

Browser fingerprinting

CAPTCHA solving

Proxy and IP management

HTTP protocols and browser networking

Browser automation tools

Job description

Senior Python Scraping Engineer

Location: Fully remote

Salary: £60,000 – £70,000

The Opportunity

I'm looking for a Python Scraping Engineer to join a growing AI-focused data team.

What You’ll Do

• Design, build, and maintain large-scale production web scrapers
• Tackle advanced anti-bot and detection systems
• Work with browser automation and dynamic, JavaScript-heavy sites
• Improve scraper reliability, throughput, and data quality
• Collaborate closely with data engineers and AI teams to ensure scraped data is trusted and usable

What We’re Looking For

• Strong Python-based scraping experience (production, large-scale)
• Deep knowledge of:
• Anti-bot detection & evasion
• Browser fingerprinting
• CAPTCHA solving
• Proxy and IP management
• HTTP protocols and browser networking
• Hands-on experience with browser automation tools (e.g. Playwright, Selenium, Puppeteer)
• Comfortable debugging complex scraping failures at scale

Tech Preferences

• Python (preferred)

Interview Process

1. CTO interview
2. Meet the team