Remote Web Scraping Engineer (US Citizen)

Powerhouse Institute, Inc.; Maryland; On-site; USD 90,000 - 130,000; Full time

Job summary

Powerhouse Institute, Inc. seeks a Web Scraping Engineer (U.S. Citizen) for a fully remote role. You will develop and maintain web scraping scripts, extract data from websites and APIs, and optimize pipelines while collaborating with data engineers and scientists.

Candidates should have 3+ years in web scraping, strong Python and Java, experience with Beautiful Soup, Scrapy or Selenium, and a BS/BA in CS or related field. Remote work is allowed for DMV residents; public trust preferred.

Qualifications

• 3+ years of professional experience in web scraping or a similar role.
• Proficiency in Python and Java and experience with web scraping libraries such as Beautiful Soup, Scrapy, or Selenium.
• Knowledge of AI/machine learning techniques for data extraction and classification.
• Experience working with APIs and handling different data formats (JSON, XML, etc.).
• Familiarity with database systems and SQL for data storage and retrieval.
• BS/BA degree in Computer Science, Information Sciences, or related IT discipline. Additional years of related professional experience can be substituted for a BS/BA degree.

Responsibilities

• Support the development and maintenance of the agency’s web scraping infrastructure.
• Develop and maintain web scraping scripts and tools to extract data from websites and APIs.
• Collaborate with cross-functional teams to understand data requirements and implement scraping solutions accordingly.
• Monitor and troubleshoot scraping processes to ensure data quality and accuracy.
• Optimize scraping scripts for performance and efficiency, considering speed, scalability, and resource utilization.
• Stay up to date with the latest web scraping techniques, tools, and best practices.
• Document and communicate technical solutions, processes, and best practices to team members.

Skills

Python

Java

APIs

Data extraction

Data cleaning

SQL

Problem solving

Teamwork

Communication

Education

BS/BA in Computer Science or related IT discipline

Tools

Beautiful Soup

Scrapy

Selenium

Cloud platforms (AWS/Azure)

JSON/XML

Job description

Powerhouse Institute, Inc. seeks a Web Scraping Engineer (U.S. Citizen) for a fully remote role. You will develop and maintain web scraping scripts, extract data from websites and APIs, and optimize pipelines while collaborating with data engineers and scientists.

Candidates should have 3+ years in web scraping, strong Python and Java, experience with Beautiful Soup, Scrapy or Selenium, and a BS/BA in CS or related field. Remote work is allowed for DMV residents; public trust preferred.