Web Automation Engineer

Engg

San Francisco (CA)

On-site

USD 235,000 - 260,000

Full time

8 days ago
Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity
15 days PTO
Parental leave (12 weeks)
Wellness stipend
Learning & Development
Team offsites
Sabbatical

Job summary

Firecrawl is seeking a WEB AUTOMATION ENGINEER to help keep our web scraping at scale fast, reliable, and resilient. You will research and engineer defense against detection mechanisms and build production-grade automation tooling.

We value deep understanding of browser internals, network fundamentals, and the ability to ship fixes into production quickly. This is a high-urgency, impact-driven role based on the SF HQ or Toronto Hub.

Qualifications

  • 3+ years building browser automation, web infrastructure, or systems-level software.
  • Strong JavaScript/TypeScript and/or Python, and ability to pick up new tech.
  • Experience with headless browsers and automation tools

Responsibilities

  • Reverse engineer detection: research how modern sites detect and challenge automated traffic.
  • Find signals: identify browser, device, network, and behavioral signals that separate automated access.
  • Replicate and harden: reproduce signals in authorized test environments to validate approaches.
  • Turn research into production: build automation, diagnostics, and monitoring tools for reliability at scale.
  • Own scrape success rate: measure, explain regressions, and ship fixes.
  • Ship fleet-wide: roll improvements across the crawling fleet at scale.

Skills

JavaScript/TypeScript
Python
Web automation

Tools

Playwright
Puppeteer
CDP

Job description

WEB AUTOMATION ENGINEER

You'll keep Firecrawl connected to the open web. Every product we ship depends on reliably accessing pages at web scale, and the modern web actively resists automation with detection systems, challenge flows, and fingerprinting that evolve weekly. This role is equal parts research and engineering: understand how those systems work at the deepest level, then turn that understanding into infrastructure that keeps our scraping fast, reliable, and resilient. If you like taking apart obfuscated JavaScript on a Tuesday and shipping the fix to production on Wednesday, this is for you.

Salary Range: $235,000–$260,000 USD/year (SF) / $217,000–$233,000 CAD/year (Toronto)

Equity Range: Competitive equity. Details shared during the process.

Location: San Francisco, CA (SF HQ) or Toronto, ON (Toronto Hub). On-site, five days a week.

Job Type: Full-Time

Experience: 3+ years building browser automation, web infrastructure, or systems-level software

Work Authorization: Must be authorized to work in the United States or Canada. We're not able to sponsor US visas right now. For Canada, we'll consider sponsorship on a case-by-case basis through our Toronto Hub.

ABOUT FIRECRAWL

Firecrawl is the easiest way to turn the web into data AI agents can use. One API call converts any URL into clean, LLM-ready markdown or structured data. It's the boring-hard problem everyone building with LLMs eventually hits, solved. We hit 8 figures in ARR in year one and more than doubled it in year two. We have 180k+ GitHub stars, putting us in the top 50 repositories of all time, and developers, agents, and category-defining AI companies build on us every day. Growth like this is rare, and we're just getting started. We're a small team punching far above our weight, working out of SF HQ and our new Toronto Hub. Everyone here owns a real piece of the product and company, end to end, and runs it themselves. No hiding behind process or headcount. This is a place for people who want to work at the frontier: an AI company building the infrastructure other AI companies run on, not one bolting AI onto an existing product. We move fast, go deep, and are building the tools superintelligence will rely on to gather data from the web.

WHAT YOU'LL DO
  • Reverse engineer detection: Research how modern websites detect and challenge automated traffic, and take apart those mechanisms and challenge flows
  • Find the signals: Identify the browser, device, network, and behavioral signals that separate automated access from human traffic
  • Replicate and harden: Reproduce those signals synthetically in authorized test environments to validate and harden our approaches
  • Turn research into production: Build the automation, diagnostic, and monitoring tools that keep scrape reliability high as the web shifts
  • Own scrape success rate: Measure it, explain regressions, and ship the fixes
  • Ship fleet-wide: Work with platform engineers to roll improvements out across the crawling fleet at scale
WHAT WE'RE LOOKING FOR
  • Languages: Strong JavaScript/TypeScript and/or Python, and comfortable picking up whatever a problem demands
  • Browser internals: Real understanding of rendering, JS engines, headless automation (CDP, Playwright, Puppeteer), and where automated browsers differ from real ones
  • Network fundamentals: Solid grasp of HTTP/TLS, proxies, and browser and device fingerprinting
  • Reverse-engineering instincts: You can read minified, obfuscated code and figure out what it's actually checking
  • Research with a shipping habit: You go deep on how something works, then land the fix in production, not just a writeup
  • Nice to have: Deobfuscating JavaScript and VM-based obfuscation, network-level fingerprinting (TLS/HTTP2 signatures, JA3/JA4), running large browser or proxy fleets in production, or prior work at a scraping, web data, security research, or automation company
WHAT WE'RE NOT LOOKING FOR
  • Needs a spec: Someone who needs a fully specced ticket to start
  • Narrow lane: Someone who wants to specialize narrowly and hand off everything else
  • Process first: Someone who optimizes for process over shipping
A NOTE ON PACE

We operate at an absurd level of urgency because the window for what we're building won't stay open forever. If that excites you, keep reading. If it doesn't, no hard feelings, but this role probably isn't for you.

BENEFITS & PERKS AVAILABLE TO ALL EMPLOYEES
  • Salary that makes sense: $235,000–$260,000 USD/year (SF) / $217,000–$233,000 CAD/year (Toronto), based on impact, not tenure
  • Own a piece: Gain competitive equity in what you're helping build
  • Generous PTO: 15 days mandatory, anything after 24 days, just ask (holidays excluded). Take the time you need to recharge
  • Parental leave: 12 weeks fully paid, for all parents
  • Wellness stipend: $100 USD/month for the gym, therapy, massages, or whatever keeps you human
  • Learning & Development: Expense up to $1,000 USD/year toward anything that helps you grow professionally
  • Team offsites: A change of scenery, minus the trust falls
  • Sabbatical: 3 paid months off after 4 years, do something fun and new
AVAILABLE TO US-BASED FULL-TIME EMPLOYEES
  • Full coverage, no red tape: Medical, dental, and vision (100% for employees, 50% for partner and kids). No weird loopholes, just care that works
  • Life & Disability insurance: Employer-paid basic life and AD&D, short-term disability, and long-term disability. Coverage for life's curveballs
  • Virtual care and a health guide: Teladoc for the couch doctor visit, plus Rightway to answer coverage questions and fight billing errors for you
  • Mental health: Talkspace, therapy and psychiatry on your schedule
  • Fertility and family building: Carrot, covering you and your partner
  • EAP: Free confidential counseling, legal and financial consults, and online will prep through Guardian
  • 401(k) plan: Retirement might be a ways off, but future-you will thank you
  • Pre-tax benefits: HSA, FSA, and commuter benefits to help your wallet
Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Web Automation Engineer
Web Automation Engineer

Firecrawl • San Francisco (CA), Northern (KY)

Hybrid
USD 235,000 - 260,000
Salary equity
Generous PTO
Parental leave
+5
Agent Experience Engineer
Agent Experience Engineer

Showcify • San Francisco (CA)

On-site
USD 235,000 - 260,000
Competitive equity
Generous PTO
Parental leave
+4
Open Source Engineer
Open Source Engineer

Mendable • San Francisco (CA)

On-site
USD 235,000 - 260,000
Equity
Generous PTO
Parental leave
+5
Head of Growth Marketing
Head of Growth Marketing

Mendable • San Francisco (CA)

Hybrid
USD 200,000 - 250,000
Equity
PTO 15 days
Parental leave
+10
Product Engineer - Agent
Product Engineer - Agent

Showcify • San Francisco (CA)

On-site
USD 235,000 - 260,000
Salary range
Equity
15 days PTO
+5
Enterprise Solutions Engineer
Enterprise Solutions Engineer

Showcify • San Francisco (CA)

On-site
USD 235,000 - 260,000
Salary + equity
Generous PTO
Parental leave
+4
Deputy Chief of Staff
Deputy Chief of Staff

Visa Hunt • San Francisco (CA)

Hybrid
USD 150,000 - 185,000
Salary that makes sense
Own a piece
Full coverage, no red tape
+14
Product Engineer - Marketplace
Product Engineer - Marketplace

Firecrawl • San Francisco (CA)

On-site
USD 235,000 - 260,000
Generous PTO
Parental leave
Wellness stipend
+3
Product Engineer - Agent
Product Engineer - Agent

Firecrawl • San Francisco (CA), Northern (KY)

On-site
USD 235,000 - 260,000
Salary that makes sense
Competitive equity
Generous PTO
+5
Search Engineer
Search Engineer

Firecrawl • San Francisco (CA)

On-site
USD 190,000 - 260,000
Salary that makes sense
Equity up to 0.05%
Generous PTO
+5