Director of Software Eng – Node.js & Web Scraping Leader

PortPro; United States; Remote; USD 180,000 - 240,000; Full time

Job summary

PortPro is seeking a Director of Software Engineering to lead a high-performing team building scalable web scraping systems using Node.js. You will design data extraction pipelines, optimize anti-bot evasion, and manage distributed architectures in the cloud.

The role emphasizes collaboration with Product, DevOps, and Data Science to deliver data-driven insights. The ideal candidate brings 10+ years in software engineering, 5+ years in web scraping, and deep experience with CI/CD, containers,

Qualifications

• 10+ years of software engineering experience.
• 5+ years in web scraping and large-scale data extraction.
• Strong hands-on expertise with Node.js and headless browser automation.

Responsibilities

• Architect, develop, and maintain scalable distributed web scraping systems using Node.js.
• Design and implement data extraction pipelines for large volumes of structured and unstructured data.
• Develop solutions to bypass anti-bot mechanisms including CAPTCHA handling and IP rotation.
• Optimize scraping processes for performance, reliability, and efficiency with proxy services.
• Collaborate with Product, DevOps, and Data Science to integrate data into analytics.

Skills

Node.js

Web scraping

Team leadership

Cloud architectures

CI/CD

Proxy management

NoSQL databases

Data pipelines

Education

Bachelor's degree in CS

Tools

Puppeteer

Playwright

Cheerio

Selenium

Kafka

Spark

Docker

Kubernetes

Redis

Job description

PortPro is seeking a Director of Software Engineering to lead a high-performing team building scalable web scraping systems using Node.js. You will design data extraction pipelines, optimize anti-bot evasion, and manage distributed architectures in the cloud.

The role emphasizes collaboration with Product, DevOps, and Data Science to deliver data-driven insights. The ideal candidate brings 10+ years in software engineering, 5+ years in web scraping, and deep experience with CI/CD, containers,