AI-Driven Web Scraping Engineer for High-Scale Crawlers

Lever, Inc.; Warszawa; On-site; PLN 234,000 - 368,000; Full time

Benefits offered by this job

Private health insurance

Gym access and well-being programs

Team events and workation

Job summary

Lever, Inc. is seeking a Web Scraping Engineer to design and build high-scale crawlers and parsers using Python or Go. You will own projects end-to-end, leveraging AI tools to accelerate development within a data engineering-focused team.

The role emphasizes rapid delivery over perfection, with a focus on scalable scraping infrastructure, integration with PostgreSQL/BigQuery, and cloud hosting. Warsaw-based on-site role with competitive PLN compensation.

Qualifications

• Multiple years of backend development experience or strong web scraping expertise driven by AI tools.
• Familiarity with web scraping fundamentals, parsing, headless browsers, and databases like PostgreSQL or BigQuery.
• High level of independence—you can align on an approach and fully own the delivery.
• Business-first mindset prioritizing speed and delivery, with openness to direct feedback.
• Hands-on experience with AI-driven development tools such as Cursor, Claude Code, or Antigravity.

Responsibilities

• Design and build high-scale crawlers, scrapers, and the surrounding infrastructure handling thousands to millions of requests.
• Take client requirements and own projects end-to-end, building custom solutions from scratch.
• Write functional, reusable code in Python or Go, leveraging AI-driven IDEs for efficiency.
• Work within our data platform to enable seamless building and delivery of large datasets.
• Use internal scraping tools or build new ones as priorities and client routes change.
• Justify technical decisions, perform code reviews, and collaborate to ensure quality solutions.

Skills

Python

Go

Web scraping

Tools

PostgreSQL

BigQuery

Playwright

Airflow

Job description

Lever, Inc. is seeking a Web Scraping Engineer to design and build high-scale crawlers and parsers using Python or Go. You will own projects end-to-end, leveraging AI tools to accelerate development within a data engineering-focused team.

The role emphasizes rapid delivery over perfection, with a focus on scalable scraping infrastructure, integration with PostgreSQL/BigQuery, and cloud hosting. Warsaw-based on-site role with competitive PLN compensation.