Remote Senior Data Infrastructure Engineer – Scraping & Scale

Jobgether SRL; Belgique; Remote; EUR 90,000 - 130,000; Full time

Benefits offered by this job

Fully remote work arrangement

Full-time employment

Job summary

Jobgether SRL is seeking a Senior Data Infrastructure Engineer to design and scale high-performance web scraping and data ingestion systems. This fully remote role is based in Belgium and focuses on collecting millions of profiles, posts, and video records daily while handling anti-bot challenges and building resilient pipelines.

The candidate will lead development of scalable data collection, orchestration, and storage, enabling downstream AI and analytics workflows with robust data

Qualifications

• 4+ years of high-volume web scraping or data engineering.
• Experience with anti-bot systems (Cloudflare, Akamai, PerimeterX).
• Proficiency in Python or Go.
• Experience with Playwright, Puppeteer, Scrapy, or Selenium.
• Knowledge of distributed queues: Temporal, Ray, Kafka, Redis.
• Strong SQL and data lake/warehouse skills.

Responsibilities

• Lead development and maintenance of scalable data collection systems.
• Design and manage web scraping infrastructure with proxies, TLS fingerprinting, and session rotation.
• Build fault-tolerant, high-throughput scraping pipelines for multiple platforms.
• Architect storage for structured and unstructured data (Parquet, Iceberg, Snowflake, S3).
• Implement monitoring, alerts, and recovery for platform changes and proxy failures.
• Ensure reliable data ingestion at scale to support daily processing of millions of records.

Skills

Python

Go

Distributed systems

SQL

Browser automation

Anti-bot systems

Tools

Playwright

Puppeteer

Scrapy

Selenium

Temporal

Kafka

Celery

Redis

Snowflake

S3

Apache Iceberg

Parquet

Ray

Job description

Jobgether SRL is seeking a Senior Data Infrastructure Engineer to design and scale high-performance web scraping and data ingestion systems. This fully remote role is based in Belgium and focuses on collecting millions of profiles, posts, and video records daily while handling anti-bot challenges and building resilient pipelines.

The candidate will lead development of scalable data collection, orchestration, and storage, enabling downstream AI and analytics workflows with robust data