Web Crawler & Fetch/Render Reliability Engineer

Perplexity

London

On-site

CAD 110,000 - 160,000

Full time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Perplexity is seeking a Web Access Engineer for the Crawler team to build reliable fetching and rendering systems powering AI-powered search. You will diagnose network and rendering issues, implementing production fixes that improve content quality at scale.

You will investigate DNS, TLS, HTTP, caching, redirects, and client-side rendering, ensuring access policies are respected while advancing crawling performance and reliability.

Qualifications

  • 5+ years in software engineering for web infrastructure, browsers, CDNs or crawling.
  • Strong programming skills in Go, Python, Rust or C++.
  • Experience debugging web rendering and network stack.

Responsibilities

  • Own fetching and rendering improvements end to end, from investigation to production rollout.
  • Investigate fetch and rendering failures across DNS, TLS, HTTP, caching, redirects, and client-side rendering.
  • Improve page loading, content capture, and completion detection for dynamic pages.
  • Ensure crawler respects site access restrictions and rate limits.
  • Build tools to reproduce failures and create regression tests.
  • Define metrics for fetching reliability and content completeness.

Skills

Web infrastructure
Go
Python
Rust
C++
Browser debugging

Tools

Chrome DevTools
CDP
HAR files
curl

Job description

Perplexity is seeking a Web Access Engineer for the Crawler team to build reliable fetching and rendering systems powering AI-powered search. You will diagnose network and rendering issues, implementing production fixes that improve content quality at scale.

You will investigate DNS, TLS, HTTP, caching, redirects, and client-side rendering, ensuring access policies are respected while advancing crawling performance and reliability.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Member of Technical Staff (Web Access Engineer, Crawler)
Member of Technical Staff (Web Access Engineer, Crawler)

Perplexity • London

On-site
CAD 110,000 - 160,000
Member of Technical Staff (Site Reliability Engineer, Crawler)
Member of Technical Staff (Site Reliability Engineer, Crawler)

Perplexity • London

On-site
CAD 120,000 - 160,000
Software Developer (Content Integration & Data Pipelines)
Software Developer (Content Integration & Data Pipelines)

Agility PR Solutions • Ottawa

Remote
CAD 75,000 - 110,000
Fully remote work
RRSP matching
Life Insurance
+4
Software Developer (Content Integration & Data Pipelines)
Software Developer (Content Integration & Data Pipelines)

Agility PR Solutions LLC • Ottawa

Remote
CAD 75,000 - 110,000
RRSP matching
Life Insurance
Employee Assistance Program (EAP)
+1
Software Developer (Content Integration & Data Pipelines)
Software Developer (Content Integration & Data Pipelines)

Agility PR Solutions • Ottawa

Remote
CAD 75,000 - 110,000
Fully remote work environment
RRSP matching
Life Insurance
+2
Junior Software Developer (Content Integration & Data Pipelines)
Junior Software Developer (Content Integration & Data Pipelines)

Agility PR Solutions LLC • Ottawa

Remote
CAD 65,000 - 75,000
Fully remote work environment
RRSP matching
Life Insurance
+3
Full Stack Engineer
Full Stack Engineer

RFPs.ai • Canada

Remote
CAD 90,000 - 120,000
Junior Software Developer (Content Integration & Data Pipelines)
Junior Software Developer (Content Integration & Data Pipelines)

Agility PR Solutions • Ottawa

Remote
CAD 65,000 - 75,000
Remote-friendly
RRSP matching
Life Insurance
+3
API Reliability Engineer – Enterprise Uptime & Resilience
API Reliability Engineer – Enterprise Uptime & Resilience

Deliverect • Toronto

On-site
CAD 90,000 - 130,000
Staff Machine Learning Engineer (Copy) (Copy)
Staff Machine Learning Engineer (Copy) (Copy)

Fetch • Canada

Remote
CAD 140,000 - 190,000