Remote Senior Data Infrastructure Engineer Scraping & Scale

Jobgether SRL; Saudi Arabia; Remote; SAR 320,000 - 520,000; Full time

Benefits offered by this job

Fully remote work

Job summary

Partner Company is seeking a Senior Data Infrastructure Engineer (Scraping & Scale) to design and scale high-performance web scraping and data ingestion systems. This fully remote role in Saudi Arabia will build core infrastructure for millions of profiles, posts, and video records daily, tackling anti-bot challenges and ensuring reliable data delivery at scale.

You will lead development of scalable data collection systems, manage fault-tolerant pipelines, and enable AI/analytics workflows

Qualifications

• 4+ years in high-volume web scraping or data engineering.
• Experience handling advanced anti-bot systems (Cloudflare/Akamai/PerimeterX).
• Proficient in Python or Go.
• Experience with Playwright, Puppeteer, Scrapy or Selenium.

Responsibilities

• Design and maintain scalable web scraping infrastructure.
• Build high-throughput scraping pipelines for multiple platforms.
• Develop distributed queues and workflow orchestration (Temporal, Ray, Kafka, Celery).
• Architect storage for structured and unstructured data (Parquet, Iceberg, Snowflake, S3).
• Add monitoring, alerts, and recovery for platform changes and proxy failures.

Skills

Web scraping

Data engineering

Distributed systems

Python

Go

Tools

Playwright

Puppeteer

Scrapy

Selenium

Temporal

Ray

Kafka

Redis

Job description

Partner Company is seeking a Senior Data Infrastructure Engineer (Scraping & Scale) to design and scale high-performance web scraping and data ingestion systems. This fully remote role in Saudi Arabia will build core infrastructure for millions of profiles, posts, and video records daily, tackling anti-bot challenges and ensuring reliable data delivery at scale.

You will lead development of scalable data collection systems, manage fault-tolerant pipelines, and enable AI/analytics workflows