Backend Infrastructure Engineer, Anti-Bot

True Talent Solutions Partners

San Francisco (CA)

Hybrid

USD 235,000 - 260,000

Full time

11 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

True Talent Solutions Partners in San Francisco is seeking an experienced backend infrastructure engineer to own production systems for high-volume web extraction. You will architect proxy rotation, IP management, and egress isolation to keep data flowing even as sites adapt defenses.

You’ll work on browser fingerprinting, CAPTCHA handling, and observability with Prometheus and Grafana, and collaborate across teams to keep deployments reliable in a hybrid, SF-based role.

Qualifications

  • Over 3 years of experience in adversarial web infrastructure or proxy-layer engineering.
  • Production experience building proxy rotation, IP and session management, egress isolation, and proxy economics.
  • Experience bypassing aggressive anti-bot defenses and operating browser or TLS fingerprinting and CAPTCHA or challenge-solving systems at production scale.
  • Proficiency in Go and/or Python, plus strong networking fundamentals including TCP/IP, HTTP/2, connection pooling, and proxy orchestration.
  • Experience owning production systems end to end, including on-call, observability, and reliability work.
  • Familiarity with headless browsers, TypeScript, Node.js, Redis, PostgreSQL, Kafka, Kubernetes, Docker, AWS, Terraform, and CI/CD.

Responsibilities

  • Architect and operate proxy rotation, IP and session management, and isolated egress nodes for third-party web extraction.
  • Improve extraction success against anti-bot and anti-scraping defenses through production-tested evasion systems.
  • Build and maintain browser and TLS fingerprint management, plus CAPTCHA and challenge-handling infrastructure.
  • Monitor proxy-layer health and cost efficiency, and improve its operating economics.
  • Diagnose intermittent failures across the stack, implement lasting fixes, and support production systems through on-call ownership.
  • Develop observability and on-call tooling using systems such as Prometheus and Grafana.

Skills

Proxy rotation
IP management
Session management
Browser fingerprinting
CAPTCHA solving
Go
Python
Networking fundamentals
On-call ownership
Observability
Headless browsers
TypeScript
Node.js
Redis
PostgreSQL
Kafka
Kubernetes
Docker
AWS
Terraform
CI/CD

Tools

Redis
PostgreSQL
Kafka
Kubernetes
Docker
AWS
Terraform
CI/CD

Job description

About the Role

Join the backend infrastructure team at a B2B SaaS web data infrastructure company, building systems that keep web extraction reliable against sites that actively block automated access. You will own production infrastructure end to end and help ensure high-volume extraction continues to work as website defenses change.

What You'll Do
  • Architect and operate proxy rotation, IP and session management, and isolated egress nodes for third-party web extraction.

  • Improve extraction success against anti-bot and anti-scraping defenses through production-tested evasion systems.

  • Build and maintain browser and TLS fingerprint management, plus CAPTCHA and challenge-handling infrastructure.

  • Monitor proxy-layer health and cost efficiency, and improve its operating economics.

  • Diagnose intermittent failures across the stack, implement lasting fixes, and support production systems through on-call ownership.

  • Develop observability and on-call tooling using systems such as Prometheus and Grafana.

What We're Looking For
  • More than 3 years of experience in adversarial web infrastructure or proxy-layer engineering, with recent web extraction work as a core part of your role.

  • Hands-on production experience building proxy rotation, IP and session management, egress isolation, and proxy economics for web extraction.

  • Experience bypassing aggressive anti-bot defenses and operating browser or TLS fingerprinting and CAPTCHA or challenge-solving systems at production scale.

  • Proficiency in Go and/or Python, plus strong networking fundamentals including TCP/IP, HTTP/2, connection pooling, and proxy orchestration.

  • Experience owning production systems end to end, including on-call, observability, and reliability work.

  • Familiarity with relevant tools and technologies such as headless browsers, TypeScript, Node.js, Redis, PostgreSQL, Kafka, Kubernetes, Docker, AWS, Terraform, and CI/CD.

Compensation & Benefits

Base salary is $235,000 to $260,000 annually. Visa sponsorship is available.

Location

Hybrid role based in San Francisco, California, United States.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Anti-Bot Engineer (Fully Remote)
Senior Anti-Bot Engineer (Fully Remote)

Adthena • United States

Remote
USD 110,000 - 160,000
Unlimited vacation
Remote-first
Stock options
+3
AI Web Scraping Engineer (Stealth Data Acquisition)
AI Web Scraping Engineer (Stealth Data Acquisition)

Workana LLC • United States

Remote
USD 140,000 - 200,000
Compensation in USD
Fully remote
Career growth
Senior Anti-Bot / Scraping Engineer (EU Applicants Only)
Senior Anti-Bot / Scraping Engineer (EU Applicants Only)

Openkrill • United States

Remote
USD 140,000 - 190,000
Stock Options
Remote-first
Home Office Stipend
Software Engineer
Software Engineer

saas.group • United States

Remote
USD 140,000 - 210,000
100% удаленная работа
Гибкий отпуск
Команда с высокой автономией и поддерж
Proxy Network Engineer
Proxy Network Engineer

SearchApi, LLC • United States

Remote
USD 120,000 - 180,000
Senior Anti-Bot Engineer — Large-Scale Web Scraping
Senior Anti-Bot Engineer — Large-Scale Web Scraping

Adthena • United States

Remote
USD 120,000 - 170,000
Remote-First
Stock Options
Home Office Stipend
+2
Product Engineer - Scrape
Product Engineer - Scrape

MAP SSG • San Francisco (CA)

Hybrid
USD 217,000 - 260,000
Equity
Backend Infrastructure Engineer
Backend Infrastructure Engineer

Strategic Employment Partners (SEP) • San Francisco (CA)

On-site
USD 180,000 - 220,000
Remote Anti-Bot Evasion Engineer
Remote Anti-Bot Evasion Engineer

SearchApi • United States

On-site
USD 150,000 - 230,000
Fully remote
Equity share
Profit sharing
+1
Web Scraping Specialist
Web Scraping Specialist

Hypersonix Inc. • United States

On-site
USD 90,000 - 180,000
Work from Home