Remote Python Engineer — Web Crawlers & Scrapy

ZYTE; United States; Remote; USD 100,000 - 140,000; Full time

Benefits offered by this job

35 days paid holidays

Flexible remote work

Job summary

Zyte is hiring Software Engineers to join the Delivery team to build web crawlers using Scrapy, the company’s flagship open-source project. You will design, develop and maintain crawlers and help grow distributed extraction capabilities.

The role emphasizes working with open source tools, large-scale data processing and performance tuning, with flexibility to work from wherever you do your best work.

Qualifications

• 3+ years of software development experience in Python.
• Solid Python knowledge.
• Familiarity with Linux/UNIX, HTTP, HTML, Javascript and Networking.
• Good communication in written and spoken English.
• Availability to work full time.

Responsibilities

• Design, develop and maintain Scrapy web crawlers.
• Leverage the Zyte platform and our open source projects to perform distributed information extraction, retrieval and data processing.
• Identify and resolve performance and scalability issues with distributed crawling at scale.
• Help identify, debug and fix problems with open source projects, including Scrapy.

Skills

Python

Linux/UNIX

Web tech (HTTP/HTML/JS)

English communication

Full-time availability

Tools

Scrapy

NLTK

pandas

scikit-learn

MapReduce

NoSQL

Job description

Zyte is hiring Software Engineers to join the Delivery team to build web crawlers using Scrapy, the company’s flagship open-source project. You will design, develop and maintain crawlers and help grow distributed extraction capabilities.

The role emphasizes working with open source tools, large-scale data processing and performance tuning, with flexibility to work from wherever you do your best work.