Web Scraping Engineer - Scale & AI-Powered Crawlers

Source.ai; United States; Remote; USD 60,000 - 94,000; Full time

Benefits offered by this job

Health insurance

Psychotherapy

Wellness app

Team events

Overseas workation

Extra vacation days

Learning options

Mentorship

Conferences

Job summary

Oxylabs, part of Source.ai, is seeking a Web Scraping Engineer to design high-scale crawlers and parsers. You will bring strong Python or Go skills to a data engineering–focused group and own projects end-to-end, delivering fast, scalable solutions in a fast-paced environment.

The role emphasizes taking client requirements, leveraging AI tools, and building from scratch, with a strong focus on speed and delivery over perfection.

Qualifications

• Multiple years of backend development experience with Python or Go.
• Familiar with web scraping fundamentals, parsing, headless browsers and PostgreSQL/BigQuery.
• Independent and able to own delivery end-to-end.
• Comfortable with AI-driven development tools (Cursor, Claude Code, etc.).

Responsibilities

• Design and build high-scale crawlers, scrapers, and infrastructure for thousands to millions of requests.
• Take client requirements and own projects end-to-end, building solutions from scratch.
• Write reusable Python or Go code, leveraging AI-driven IDEs for efficiency.
• Work within our data platform to enable seamless large dataset delivery.
• Use internal scraping tools or build new ones as priorities shift.
• Justify decisions, perform code reviews, and collaborate with the team.

Skills

Python

Go

Web scraping

AI-driven tools

Tools

Playwright

Camoufox

Airflow

Claude Code

Cursor

PostgreSQL

BigQuery

Google Cloud

Job description

Oxylabs, part of Source.ai, is seeking a Web Scraping Engineer to design high-scale crawlers and parsers. You will bring strong Python or Go skills to a data engineering–focused group and own projects end-to-end, delivering fast, scalable solutions in a fast-paced environment.

The role emphasizes taking client requirements, leveraging AI tools, and building from scratch, with a strong focus on speed and delivery over perfection.