Senior Data Infrastructure Engineer — Remote Scraping

Jobgether SRL; Finland; Remote; EUR 90,000 - 130,000; Full time

Benefits offered by this job

Fully remote work arrangement

Full-time employment

Job summary

Jobgether SRL seeks a Senior Data Infrastructure Engineer (Scraping & Scale) to design and scale high-performance web scraping and data ingestion systems. This fully remote role, based in Finland, will collect millions of profiles, posts, and video records daily and tackle anti-bot challenges with distributed pipelines.

You will work at the intersection of data engineering, automation, and AI infrastructure, delivering reliable data for analytics and machine learning workflows.

Qualifications

• 4+ years in high-volume web scraping, data engineering, or reverse engineering.
• Experience handling advanced anti-bot systems (Cloudflare, Akamai, PerimeterX) via TLS impersonation, browser automation, and proxies.
• Proficiency in Python or Go.
• Experience with browser automation and scraping frameworks (Playwright, Puppeteer, Scrapy, Selenium).
• Knowledge of distributed systems and task queues (Temporal, Ray, Kafka, Redis).
• Strong SQL skills and experience with modern data lakes/warehouses.

Responsibilities

• Design and maintain scalable web-scraping infrastructure for high-throughput data collection.
• Build fault-tolerant pipelines to collect data from major platforms.
• Develop distributed queues and orchestration with Temporal, Ray, Kafka, and Celery where applicable.
• Architect storage with Parquet, Iceberg, Snowflake, and S3 for structured/unstructured data.
• Implement monitoring, alerts, and recovery for platform changes and proxy failures.
• Maintain reliable data ingestion and support daily processing of millions of records.
• Enable downstream AI/analytics workflows through robust data infrastructure.

Skills

Python

Go

Distributed systems

Anti-bot expertise

SQL

Tools

Playwright

Puppeteer

Scrapy

Selenium

Temporal

Ray

Kafka

Redis

Parquet

Iceberg

Snowflake

Amazon S3

Job description

Jobgether SRL seeks a Senior Data Infrastructure Engineer (Scraping & Scale) to design and scale high-performance web scraping and data ingestion systems. This fully remote role, based in Finland, will collect millions of profiles, posts, and video records daily and tackle anti-bot challenges with distributed pipelines.

You will work at the intersection of data engineering, automation, and AI infrastructure, delivering reliable data for analytics and machine learning workflows.