Web Scraping Engineer — Data Quality & Reliable Pipelines

Alphamatician

Oregon (WI)

On-site

USD 100,000 - 150,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Alphamatician is seeking a Web Scraping Engineer to own day-to-day data collection and quality for an institutional data product. This individual-contributor role is embedded in our data operations and focuses on reliable scraping at scale, handling hard targets and evolving sites.

You will review overnight pipelines, fix scraping logic, run quality checks, and respond to client inquiries. The role emphasizes practical problem solving on a mature data platform with continual improvements.

Qualifications

Production PHP experience with public work to cite (repo/blog/post).
Python proficiency with modern scraping libraries (Playwright, Scrapy, Selenium, Requests, httpx, BeautifulSoup).
Experience scraping hard targets at scale with anti-bot defenses and dynamic content; must cite a scraper built in detail.
MySQL reading/writing and optimizing complex queries on large datasets.
US-based with verifiable employment history.
Starts at 7am US Eastern.

Responsibilities

Review overnight pipeline logs and triage failures or gaps.
Fix PHP bugs and update scrapers as sites change structure or defenses.
Update cron logic and ship incremental improvements to collection coverage and quality.
Run data quality checks against current/historical baselines for coverage and accuracy.
Answer client inquiries about coverage, methodology, or anomalies.
Discuss collection strategies and contribute to new datasets and product features.