Web Scraping Engineer – Data Reliability & Ops

Alphamatician; Indiana (PA); On-site; USD 120,000 - 180,000; Full time

Job summary

Alphamatician is seeking a Web Scraping Engineer to join as an individual contributor at the heart of our data operations. You will maintain and improve our mature alternative-data product used by institutional investors, focusing on reliability and scale.

Daily work includes reviewing overnight pipeline logs, fixing PHP issues and updating scrapers as sites change, verifying data quality, answering client inquiries, and contributing to new datasets and features.

Qualifications

• Production PHP experience with public work (repo/blog/post) required.
• Proficiency in Python scraping libraries and modern tools.
• Experience scraping hard targets at scale with anti-bot defenses.
• MySQL querying on large data sets; performance tuning.

Responsibilities

• Review overnight pipeline logs and triage issues.
• Fix PHP bugs and update scrapers as sites change structure/defenses.
• Ensure data quality and validate with historical baselines.
• Respond to client inquiries about coverage, methodology, or anomalies.
• Contribute to collection strategies and new datasets/features.

Skills

Production PHP

Public PHP work

Python scraping

Playwright

Scrapy

Selenium

Requests

httpx

BeautifulSoup

MySQL

US employment history

Tools

CodeIgniter 4

Playwright

Scrapy

Selenium

Requests

httpx

BeautifulSoup

Job description

Alphamatician is seeking a Web Scraping Engineer to join as an individual contributor at the heart of our data operations. You will maintain and improve our mature alternative-data product used by institutional investors, focusing on reliability and scale.

Daily work includes reviewing overnight pipeline logs, fixing PHP issues and updating scrapers as sites change, verifying data quality, answering client inquiries, and contributing to new datasets and features.