Remote Research Engineer — Large-Scale Web Crawlers

ElevenLabs; United States; Remote; USD 140,000 - 210,000; Full time

Job summary

ElevenLabs is seeking a Research Engineer to join our research team, focusing on large-scale web crawling for our frontier AI models. You will own crawling systems that source data from the open web and turn it into training-ready datasets.

You will design and operate distributed crawlers, tackle content extraction, deduplication, recrawl strategies, and rate-limiting, and build tooling for researchers to request, monitor, and explore newly crawled data. This role is remote globally.

Qualifications

• Hands-on experience building and scaling web crawlers or scraping systems, ideally for ML training data.
• Strong engineering skills in distributed systems at scale (e.g., Kubernetes, queue-based architectures, or custom pipelines processing billions of documents).
• Ability to autonomously evaluate the quality, coverage, and compliance of crawled data, and to build tooling to measure it.

Responsibilities

• Build and operate large-scale, distributed web crawlers that fetch and extract data from billions of pages.
• Solve crawling challenges like content extraction from messy HTML, deduplication, recrawl strategies, and rate-limiting.
• Design targeted crawling pipelines to find high-value data sources (audio, video, multilingual) and create clean training-ready datasets.
• Create tooling and infrastructure for researchers to request, monitor, and explore newly crawled web data quickly and reliably.

Skills

Web crawlers

Distributed systems

Data quality evaluation

Tools

Kubernetes

Job description

ElevenLabs is seeking a Research Engineer to join our research team, focusing on large-scale web crawling for our frontier AI models. You will own crawling systems that source data from the open web and turn it into training-ready datasets.

You will design and operate distributed crawlers, tackle content extraction, deduplication, recrawl strategies, and rate-limiting, and build tooling for researchers to request, monitor, and explore newly crawled data. This role is remote globally.