Web Automation Engineer: Build Reliable Scrapers

Firecrawl; San Francisco (CA); On-site; USD 235,000 - 260,000; Full time

Benefits offered by this job

Salary range USD 235k–260k/year (SF) /

Equity, competitive

On-site in SF Toronto hubs

Generous PTO

Parental leave

Wellness stipend

Learning & Development allowance

Team offsites

Sabbatical

Job summary

Firecrawl is hiring a Web Automation Engineer to keep our web data pipeline fast, reliable, and resilient. You will reverse‑engineer detection, identify signals distinguishing automated traffic, and turn findings into production-ready tooling, scalable across our crawling fleet.

You will work at the frontier of browser automation, with strong emphasis on research-to-production, throughput, and robustness in a fast-paced AI-enabled environment.

Qualifications

• Strong JavaScript/TypeScript and/or Python
• Deep understanding of browser internals and headless automation
• Solid grasp of HTTP/TLS, proxies, and fingerprinting
• Ability to read minified/obfuscated code
• Track record of shipping research into production
• Nice-to-have: JS obfuscation, VM obfuscation, large browser/proxy fleets

Responsibilities

• Reverse engineer detection and challenge flows
• Identify signals that distinguish automated from human traffic
• Reproduce signals in test environments to validate approaches
• Build automation, diagnostics, and monitoring tools for reliability
• Measure crawl success, explain regressions, ship fixes
• Roll improvements across crawling fleet at scale

Skills

JavaScript/TypeScript

Python

Browser internals

HTTP/TLS & Proxies

Reverse-engineering

Research-to-production

Job description

Firecrawl is hiring a Web Automation Engineer to keep our web data pipeline fast, reliable, and resilient. You will reverse‑engineer detection, identify signals distinguishing automated traffic, and turn findings into production-ready tooling, scalable across our crawling fleet.

You will work at the frontier of browser automation, with strong emphasis on research-to-production, throughput, and robustness in a fast-paced AI-enabled environment.