Web Scraping Engineer

Oxylabs.io; Warszawa; On-site; PLN 234,000 - 368,000; Full time

Benefits offered by this job

Private health insurance

On-site well-being consultants

24/7 gym access

Team events

Overseas workation

Bonus vacation days

Barista coffee

Job summary

Oxylabs.io's Web Intelligence team seeks a Web Scraping Engineer to design and build high-scale crawlers using Python or Go. You will own projects end-to-end, leveraging AI tools to accelerate development in a fast-paced environment.

You will work with PostgreSQL/BigQuery, Playwright, and internal APIs to deliver large datasets for clients, prioritizing speed and practical solutions over perfection.

Qualifications

• Backend development experience with Python or Go.
• Strong knowledge of web scraping, parsing, and headless browsers.
• Ability to own projects end-to-end with minimal specifications.
• Experience with SQL databases such as PostgreSQL or BigQuery.

Responsibilities

• Design and build high-scale crawlers, scrapers, and infra for thousands to millions of requests.
• Take client requirements and own projects end-to-end, building solutions from scratch.
• Write reusable code in Python or Go, leveraging AI-driven IDEs.
• Work within our data platform to enable large dataset delivery.
• Use internal scraping tools or build new ones as priorities and client routes change.
• Justify technical decisions, perform code reviews, and collaborate for quality solutions.

Skills

Python

Go

Web scraping

Independent delivery

AI-assisted coding

Tools

Playwright

Claude Code

Cursor

Antigravity

PostgreSQL

BigQuery

Job description

The team waiting for you:

The Web Intelligence team is responsible for building and delivering large-scale, custom datasets for clients who need end-to-end scraping solutions. As a Web Scraping Engineer, you will jump right into building high-scale crawlers and parsers, bringing strong Python or Go skills to our primarily data engineering-focused group. With a rapidly growing influx of project-based requests, we need someone who can take immediate ownership and leverage AI tools to build solutions from scratch. Your main challenge will be navigating a fast-paced environment where speed and delivery are prioritized over absolute perfection.

The team waiting for you:

The Web Intelligence team is responsible for building and delivering large-scale, custom datasets for clients who need end-to-end scraping solutions. As a Web Scraping Engineer, you will jump right into building high-scale crawlers and parsers, bringing strong Python or Go skills to our primarily data engineering-focused group. With a rapidly growing influx of project-based requests, we need someone who can take immediate ownership and leverage AI tools to build solutions from scratch. Your main challenge will be navigating a fast-paced environment where speed and delivery are prioritized over absolute perfection.

In this role, you will:

• Design and build high-scale crawlers, scrapers, and the surrounding infrastructure capable of handling thousands to millions of requests
• Take client requirements and own projects end-to-end, building custom solutions from scratch without waiting for detailed specifications
• Write functional, reusable code in Python or Go, heavily leveraging AI-driven IDEs to maximize output and efficiency
• Work within our data platform to enable the seamless building and delivery of large datasets
• Use internal scraping tools or build new ones as priorities and client routes change
• Justify technical decisions, perform code reviews, and collaborate closely with the team to ensure quality solutions

Your skills & experiences:

• Multiple years of backend development experience with Python or Go (or strong web scraping expertise driven by AI tools)
• Familiarity with web scraping fundamentals, parsing, headless browsers, and databases like PostgreSQL or BigQuery
• High level of independence—you can align on an approach in a discussion and then fully own the delivery
• A business-first mentality that prioritizes speed and delivery over perfection, with a "thick skin" for direct feedback
• Hands-on experience and a strong comfort level with AI-driven development tools (such as Cursor, Claude Code, or Antigravity)

Nice to have:

• Experience in data engineering: ETL/ELT pipelines, Spark, Airflow, Dagster, etc

Tech stack:

• Python, Go
• Databases: PostgreSQL, BigQuery
• Hosting: Google Cloud, Hetzner, private cloud
• Scraping tools: Playwright, internal APIs, Camoufox, headless browsers
• Data Engineering: Airflow
• AI tools: Claude Code, Cursor

Salary & Benefits

• Gross salary: 21,000 - 33,000 PLN/month. Keep in mind that we are open to discuss a different salary based on your skills and competencies
• Growth & Learning: 40+ internal learning options, external conferences, mentorship, and year-round knowledge-sharing
• Health & Well-being: Private health insurance, psychotherapy, on-site well-being consultants, 24/7 gym access, and a wellness app
• Celebration & Community: Team events, an overseas workation, quarterly team-building budgets, and plenty of ways to mark milestones together
• Plus bonus vacation days, paid life-moment days off, barista coffee, and all the tools you need. See the full list of benefits here: https://career.oxylabs.io/blog/our-work-benefits/

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.