Remote Web Scraping Engineer | Scalable Data Pipelines

Wynd Labs; United States; Remote; USD 110,000 - 170,000; Full time

Benefits offered by this job

Opportunity

Culture

Compensation

Job summary

Wynd Labs is seeking a Web Scraping Specialist to lead data extraction efforts, optimize scraping pipelines, and analyze data for high‑quality public web datasets.

You will work on a distributed crawler platform with a small team, leveraging Python or JavaScript and libraries like BeautifulSoup, Scrapy, or Selenium, plus asynchronous techniques.

This fully remote role offers a competitive salary, equity, and the chance to shape the data infrastructure powering frontier AI models.

Qualifications

• Proven ability to extract data from complex websites with minimal supervision, with a portfolio or examples of past projects.
• Proficiency in Python or JavaScript, with strong skills in libraries and frameworks like BeautifulSoup, Scrapy, or Selenium.
• Knowledge of asynchronous programming, multithreading, and distributed scraping.
• In-depth knowledge of HTML, CSS, JavaScript, and the DOM.
• Experience with NoSQL databases (MongoDB, Cassandra), capable of designing efficient storage solutions and managing data integrity.
• Ability to apply machine learning algorithms for data cleaning, categorization, or predictive analysis adds significant value.
• Experience with cloud services (AWS, Google Cloud, Azure) for deploying and managing scraping jobs at scale.
• Active participation in open-source projects related to web scraping, data processing, or similar fields.

Responsibilities

• Write, test, and refine code that extracts data from various online sources, ensuring reliability and efficiency.
• Perform data retrieval tasks, handling complexities such as pagination and dynamic content loaded with AJAX.
• Clean and format extracted data, ensuring it meets quality standards for further analysis or processing.
• Database management: Store and manage the scraped data in appropriate databases, optimizing for access speed and data integrity.
• Regularly monitor the scraping processes, identify and resolve any issues to maintain continuous data flow.

Skills

Data extraction

Python/JavaScript

HTML/CSS/DOM

NoSQL databases

ML for data cleaning

Open-source contributions

Tools

BeautifulSoup

Scrapy

Selenium

Job description

Wynd Labs is seeking a Web Scraping Specialist to lead data extraction efforts, optimize scraping pipelines, and analyze data for high‑quality public web datasets.

You will work on a distributed crawler platform with a small team, leveraging Python or JavaScript and libraries like BeautifulSoup, Scrapy, or Selenium, plus asynchronous techniques.

This fully remote role offers a competitive salary, equity, and the chance to shape the data infrastructure powering frontier AI models.