Remote Senior Data Infrastructure Engineer: Scraping & Scale

Jobgether SRL; Santiago; Hybrid; CLP 87,891,000 - 146,484,000; Full time

Benefits offered by this job

Fully remote work

Job summary

Jobgether is seeking a Senior Data Infrastructure Engineer (Scraping & Scale) based in Chile. This fully remote role focuses on building high-performance scraping and ingestion systems to process millions of profiles, posts, and videos daily.

You will tackle anti-bot challenges and develop resilient distributed pipelines for AI-ready data workflows. Responsibilities include designing scraping infrastructure with proxies, building scalable pipelines across platforms, and enabling downstream AI

Qualifications

• Experience in high-volume web scraping and data engineering.
• Strong background handling anti-bot systems using proxies and TLS impersonation.
• Proficiency in Python or Go and modern scraping frameworks.

Responsibilities

• Design and manage web scraping infrastructure with proxies, TLS fingerprinting, and session rotation.
• Build fault-tolerant pipelines to collect data from multiple platforms.
• Develop distributed queues and orchestration with Temporal, Kafka, and Celery.
• Architect storage using Parquet, Iceberg, Snowflake, and S3.
• Implement monitoring, alerts, and recovery for changes and proxy failures.
• Ensure scalable data ingestion and support daily multi-million records.

Skills

Python

Go

Web scraping

Distributed systems

SQL

Data ingestion

Tools

Playwright

Puppeteer

Scrapy

Selenium

Temporal

Ray

Apache Kafka

Celery

Redis

Job description

Jobgether is seeking a Senior Data Infrastructure Engineer (Scraping & Scale) based in Chile. This fully remote role focuses on building high-performance scraping and ingestion systems to process millions of profiles, posts, and videos daily.

You will tackle anti-bot challenges and develop resilient distributed pipelines for AI-ready data workflows. Responsibilities include designing scraping infrastructure with proxies, building scalable pipelines across platforms, and enabling downstream AI