Senior Data Infrastructure Engineer - Remote Web Scraping

Jobgether SRL; Schweiz; Remote; CHF 140,000 - 190,000; Full time

Job summary

Jobgether SRL is seeking a Senior Data Infrastructure Engineer (Scraping & Scale) based in Switzerland. You will design and scale high-performance web scraping and data ingestion systems to collect millions of social media profiles, posts, and video records daily in a fully remote role.

You will tackle anti-bot challenges, develop resilient distributed pipelines, and ensure reliable data delivery at scale, enabling downstream AI and analytics workflows with robust data infrastructure.

Qualifications

• 4+ years of experience in high-volume web scraping, data engineering, or reverse engineering.
• Experience handling advanced anti-bot systems (Cloudflare, Akamai, PerimeterX) using TLS impersonation, browser automation, and proxies.
• Proficiency in Python or Go.
• Experience with Playwright, Puppeteer, Scrapy, or Selenium.
• Experience with Temporal, Ray, Kafka, and Redis.
• Strong SQL skills and knowledge of modern data lakes and data warehouses.

Responsibilities

• Lead design and maintenance of scalable data collection systems for reliable ingestion.
• Build fault-tolerant, high-throughput scraping pipelines across multiple platforms.
• Develop distributed queues and workflow orchestration (Temporal, Ray, Kafka, Celery).
• Architect storage for structured/unstructured data (Parquet, Iceberg, Snowflake, S3).
• Implement monitoring and automated alerts for platform changes and proxy failures.
• Maintain data ingestion at scale with minimal downtime to support daily processing.

Skills

Web scraping

Distributed systems

Data engineering

Python/Go

Tools

Playwright

Puppeteer

Scrapy

Selenium

Temporal

Ray

Kafka

Celery

Redis

Parquet

Iceberg

Snowflake

Amazon S3

Job description

Jobgether SRL is seeking a Senior Data Infrastructure Engineer (Scraping & Scale) based in Switzerland. You will design and scale high-performance web scraping and data ingestion systems to collect millions of social media profiles, posts, and video records daily in a fully remote role.

You will tackle anti-bot challenges, develop resilient distributed pipelines, and ensure reliable data delivery at scale, enabling downstream AI and analytics workflows with robust data infrastructure.