Remote Python Developer - Web Crawler & Scrapy Expert

Zyte; United States; Remote; USD 120,000 - 160,000; Full time

Benefits offered by this job

35 days paid holidays

Job summary

Zyte is hiring a Software Engineer to design, develop, and maintain Scrapy web crawlers as part of the Delivery team. You will leverage the Zyte platform to build scalable crawling pipelines for large-scale data extraction.

The role emphasizes open source contributions, distributed systems, and collaboration across an international team. Candidates should have strong Python skills, Linux/Unix familiarity, and excellent written and spoken English. Remote work supported.

Qualifications

• 3+ years of software development experience in Python.
• Solid Python knowledge.
• Familiarity with Linux/UNIX, HTTP, HTML, Javascript and Networking.
• Good communication in written and spoken English
• Availability to work full time.

Responsibilities

• Design, develop and maintain Scrapy web crawlers.
• Leverage the Zyte platform and our open source projects to perform distributed information extraction, retrieval and data processing
• Identify and resolve performance and scalability issues with distributed crawling at scale
• Help identify, debug and fix problems with open source projects, including Scrapy

Skills

Python

Open source

Linux/Unix

HTTP/HTML/JS networking

English communication

Tools

Scrapy

NLTK

Pandas

scikit-learn

Job description

Zyte is hiring a Software Engineer to design, develop, and maintain Scrapy web crawlers as part of the Delivery team. You will leverage the Zyte platform to build scalable crawling pipelines for large-scale data extraction.

The role emphasizes open source contributions, distributed systems, and collaboration across an international team. Candidates should have strong Python skills, Linux/Unix familiarity, and excellent written and spoken English. Remote work supported.