AI-Driven Web Scraping Engineer for High-Scale Crawlers

Oxylabs; Warszawa; Hybrid; PLN 234,000 - 368,000; Full time

Benefits offered by this job

Private health insurance

24/7 gym access

Hybrid work (3 days office, 2 WFH)

Well-being consultants on-site

Job summary

Oxylabs is seeking a Web Scraping Engineer to design and build high-scale crawlers and the surrounding infrastructure. You will own projects end-to-end, writing Python or Go code and leveraging AI-driven IDEs to maximize output.

You will work within our data platform to deliver large datasets, and adapt tools as client routes change. The role emphasizes speed and delivery, with a business-first mentality and strong independence to own the delivery from start to finish.

Qualifications

• Multiple years of backend development experience with Python or Go.
• Hands-on experience with AI-driven development tools.
• Ability to take ownership of projects end-to-end and deliver.

Responsibilities

• Design and build high-scale crawlers and scrapers and infrastructure for handling thousands to millions of requests.
• Own client projects end-to-end from requirements to delivery, with minimal guidance.
• Write functional, reusable code in Python or Go, leveraging AI-driven IDEs for efficiency.
• Work within our data platform to enable large dataset delivery.
• Use internal scraping tools or build new ones as priorities change.
• Justify technical decisions, perform code reviews, and collaborate with the team to ensure quality solutions.

Skills

Python

Go

Backend development

AI tools

Tools

Cursor

Claude Code

Antigravity

Job description

Oxylabs is seeking a Web Scraping Engineer to design and build high-scale crawlers and the surrounding infrastructure. You will own projects end-to-end, writing Python or Go code and leveraging AI-driven IDEs to maximize output.

You will work within our data platform to deliver large datasets, and adapt tools as client routes change. The role emphasizes speed and delivery, with a business-first mentality and strong independence to own the delivery from start to finish.