Web Scraping Engineer — Scale Global Scrapers

Source; United States; Remote; USD 46,000 - 55,000; Full time

Benefits offered by this job

Learning options

Mentorship

Team events

Overseas workation

Job summary

Oxylabs, part of Source, is hiring for a role focused on building scalable scrapers and back-end solutions for scraping and parsing at scale. You will define resilient scraping strategies, unblock websites for scraping, and improve system observability while maintaining and extending the current scraping infrastructure.

The ideal candidate has strong Python experience, solid CS fundamentals, and hands-on experience with browser automation, asynchronous programming, and related tooling such as

Qualifications

• Experience with Python in a production environment.
• Strong CS fundamentals including data structures, algorithms, computability and complexity.
• Version control using Git.
• Experience unblocking websites for scraping.
• Familiarity with various scraping techniques and open-source tools.
• Comfort with using browser developer tools.
• Knowledge of network TLS/SSL.
• Experience with browser automation.
• Understanding of asynchronous programming.

Responsibilities

• Develop scalable scrapers.
• Define resilient scraping strategies and unblock websites for scraping; improve observability in the system.
• Develop back-end solutions for scraping and parsing problems of various magnitudes.
• Maintain the current system and develop new features related to scraping and parsing.

Skills

Python

Data structures

Algorithms

Git

Web scraping

Dev Tools

TLS/SSL

Browser automation

Asynchronous programming

Tools

Redis

MySQL

Docker

Kubernetes

Elasticsearch

Kibana

Grafana

Prometheus

Job description

Oxylabs, part of Source, is hiring for a role focused on building scalable scrapers and back-end solutions for scraping and parsing at scale. You will define resilient scraping strategies, unblock websites for scraping, and improve system observability while maintaining and extending the current scraping infrastructure.

The ideal candidate has strong Python experience, solid CS fundamentals, and hands-on experience with browser automation, asynchronous programming, and related tooling such as