Software developer (scraping)

Homerun; Amsterdam; On-site; EUR 70,000 - 90,000; Full time

Benefits offered by this job

Office in Amsterdam

Learning budget

Team off-sites

Conferences & courses

Job summary

Promptwatch is seeking a dedicated scraping and crawling engineer to own the infrastructure that fetches, renders, and parses web content at scale from our Amsterdam office.

You’ll work in a TypeScript codebase running on Google Cloud, directly with the founding team, with no management layers between you and the decisions. You’ll build crawlers, parsers, and data pipelines that keep data reliable and affordable as the platform grows.

Qualifications

• Strong experience with TypeScript and Node.js.
• Hands-on web scraping at scale with headless browsers (Playwright or Puppeteer).
• Deep understanding of HTTP and how sites detect bots.
• Experience with job queues, concurrency and distributed workloads.
• Patience to debug problems that occur rarely.

Responsibilities

• Build and maintain crawlers processing millions of pages daily.
• Ensure reliable data collection: retries, rate limits, proxies, and anti-bot handling.
• Write parsers to turn messy HTML and rendered pages into structured data.
• Monitor scraping health and data quality; fix issues before customers see them.
• Improve throughput and reduce costs as volume grows.

Skills

TypeScript

Node.js

Web scraping at scale

HTTP / browser behavior

Queues & concurrency

Debugging rare issues

Tools

Playwright

Puppeteer

Job description

About the job

Promptwatch shows businesses how they appear in AI-generated answers. We track citations, sentiment, and visibility across every major AI engine. Thousands of companies use the product to make decisions every day, and all of it starts with the data we collect.

The role

This is a dedicated scraping and crawling role. You'll work on the infrastructure that fetches, renders, and parses web content at scale. Pages change, sites block bots, and layouts break without warning, so a big part of the job is building systems that notice when something goes wrong and recover on their own.

You'll work in a TypeScript codebase running on Google Cloud, directly with the founding team, with no management layers between you and the decisions.

What you'll do

• Build and maintain crawlers and scrapers that process millions of pages a day
• Make data collection reliable: retries, rate limiting, proxy management, and handling blocks and CAPTCHAs
• Write parsers that turn messy HTML and rendered pages into clean, structured data
• Monitor scraping health and data quality, and fix problems before they reach customers
• Improve throughput and cost as volume grows

What we're looking for

• Solid experience with TypeScript and Node.js
• Hands‑on experience with web scraping at scale, including headless browsers (Playwright, Puppeteer, or similar)
• A good understanding of HTTP, browser behavior, and how websites detect and block bots
• Experience with job queues, concurrency, and distributed workloads
• The patience to debug problems that only show up one time in ten thousand

Nice to have

• Proxy networks and fingerprinting
• Cloud infrastructure, ideally Google Cloud
• Working with LLM APIs
• Data pipelines or search indexes (Elasticsearch or similar)

How you work

• Persistent and pragmatic
• Clear communication
• You care about data quality

What we offer

• Base salary: €70,000 - €90,000
• Ownership of a core part of the platform
• A real say in technical direction
• Time and budget for learning: conferences, courses, books
• An office in central Amsterdam
• Regular team off-sites and company sports activities

Promptwatch helps brands understand and improve how they show up in AI search across platforms like ChatGPT, Claude, Gemini, and Perplexity.

Founded in Amsterdam in 2025, we’ve grown quickly, raised €7.2M in funding, and now serve 1,800+ organizations. We’re building the infrastructure for the shift from traditional search to AI-native discovery.