Remote Senior Data Infra Engineer – Scalable Scraping

Jobgether SRL; Italia; Remote; EUR 70,000 - 110,000; Full time

Benefits offered by this job

Fully remote work

Full-time employment

Job summary

Jobgether SRL, listed on behalf of a partner company, seeks a Senior Data Infrastructure Engineer to design scalable web scraping and data ingestion systems in a fully remote role based in Italy.

You will tackle anti-bot challenges, build distributed pipelines, and ensure reliable data delivery at scale to support AI and analytics workflows across social platforms. Ideal candidates have 4+ years in data engineering and strong Python/Go skills.

Qualifications

• 4+ years of experience in high-volume web scraping, data engineering, or reverse engineering.
• Strong experience handling advanced anti-bot systems, including Cloudflare, Akamai, and PerimeterX.
• Advanced proficiency in Python or Go.
• Experience with browser automation and scraping frameworks such as Playwright, Puppeteer, Scrapy, or Selenium.

Responsibilities

• Design and manage web scraping infrastructure using residential proxy networks, TLS fingerprinting, browser automation, and session rotation.
• Build fault-tolerant, high-throughput scraping pipelines to collect data from multiple platforms.
• Develop distributed queues and workflow orchestration systems (Temporal, Ray, Kafka, Celery).
• Architect storage environments for structured and unstructured data (Parquet, Iceberg, Snowflake, S3).
• Implement monitoring, alerts, and recovery mechanisms for platform changes and proxy failures.
• Maintain reliable data ingestion at scale with daily processing of millions of records.
• Enable downstream AI and analytics workflows through robust data infrastructure.

Skills

Python

Go

SQL

Tools

Playwright

Puppeteer

Scrapy

Selenium

Temporal

Ray

Apache Kafka

Redis

Parquet

Iceberg

Snowflake

Amazon S3

Job description

Jobgether SRL, listed on behalf of a partner company, seeks a Senior Data Infrastructure Engineer to design scalable web scraping and data ingestion systems in a fully remote role based in Italy.

You will tackle anti-bot challenges, build distributed pipelines, and ensure reliable data delivery at scale to support AI and analytics workflows across social platforms. Ideal candidates have 4+ years in data engineering and strong Python/Go skills.