Remote Web Scraper for AI Training Data

Executive Staff Recruiters / ESR Healthcare; United States; Remote; USD 28,000 - 69,000; Part time

Job summary

micro1 is seeking a Web Scraper to join as a remote, part-time contractor. You will design and maintain scraping scripts to extract data from various sites, handling both static and dynamic content. Your work will focus on cleaning and structuring data for analysis, with a focus on reliability and scalability.

Strong experience with Python-based tools (Scrapy, Selenium) and data formats (JSON/XML) is essential, as is familiarity with relational or NoSQL databases and web security concepts.

Qualifications

• Experience building web scrapers with Python, Scrapy and Selenium.
• Strong understanding of HTML, CSS and JavaScript.
• Experience handling APIs, RESTful interfaces and parsing JSON/XML.
• Proficiency with data cleaning, manipulation and storage in relational or NoSQL databases.
• Knowledge of web security and ethical scraping practices.
• Ability to troubleshoot issues autonomously.

Responsibilities

• Design, develop, and maintain robust web scraping scripts and applications.
• Extract data from multiple websites, including dynamic content.
• Clean, validate, and structure large scraped data sets.
• Monitor scraping pipelines for data quality and troubleshoot failures.
• Implement solutions to bypass anti-scraping measures while maintaining effectiveness.
• Collaborate with the customer team to define data requirements and deliverables.
• Document scraping processes and maintain scalable code.

Skills

python

scrapy

selenium

html

css

javascript

rest-api

json

xml

data-cleaning

data-manipulation

nosql

relational-databases

web-security

Tools

Git

AWS

Azure

GCP

Job description

micro1 is seeking a Web Scraper to join as a remote, part-time contractor. You will design and maintain scraping scripts to extract data from various sites, handling both static and dynamic content. Your work will focus on cleaning and structuring data for analysis, with a focus on reliability and scalability.

Strong experience with Python-based tools (Scrapy, Selenium) and data formats (JSON/XML) is essential, as is familiarity with relational or NoSQL databases and web security concepts.