Senior Software Engineer - Scale Web Data Platform in NYC

String; New York (NY); On-site; USD 140,000 - 210,000; Full time

Job summary

String is building the most comprehensive platform to collect and structure data from the web, and we’re hiring to accelerate delivery. This role is based in NYC and in-person, reporting to the CTO as part of Engineering.

You will work across the stack to build scalable scraping infrastructure, handle bot-detection at scale, write scripts for many websites, fix them as sites change, and ensure data quality across runs. Equity and strong compensation accompany this opportunity.

Responsibilities

• Build scalable infrastructure to collect data from thousands of websites.
• Develop and refine techniques to avoid bot detection at scale.
• Write and maintain scripts for each website to scrape data.
• Repair and adapt scripts as websites evolve and break changes.
• Ensure consistent data quality across runs and pipelines.

Job description

String is building the most comprehensive platform to collect and structure data from the web, and we’re hiring to accelerate delivery. This role is based in NYC and in-person, reporting to the CTO as part of Engineering.

You will work across the stack to build scalable scraping infrastructure, handle bot-detection at scale, write scripts for many websites, fix them as sites change, and ensure data quality across runs. Equity and strong compensation accompany this opportunity.