Senior Data Infrastructure Engineer - Fully Remote, Scraping

Jobgether SRL; México; Remote; MXN 900,000 - 1,500,000; Full time

Benefits offered by this job

Fully remote

Full-time employment

Job summary

Jobgether SRL in Mexico is seeking a Senior Data Infrastructure Engineer to design and scale high‑performance web scraping and data ingestion systems. This fully remote role focuses on collecting millions of social profiles, posts, and video records daily while addressing anti‑bot challenges and building resilient distributed pipelines.

You will operate at the intersection of data engineering, automation, and AI infrastructure, supporting large‑scale analytics workflows and machine learning

Qualifications

• 4+ years of experience in high-volume web scraping, data engineering, or reverse engineering.
• Strong experience handling advanced anti-bot systems (Cloudflare, Akamai, PerimeterX) using TLS impersonation, browser automation and proxies.
• Advanced proficiency in Python or Go.
• Extensive experience with browser automation and scraping frameworks (Playwright, Puppeteer, Scrapy, Selenium).
• Practical knowledge of distributed systems and task queues (Temporal, Ray, Kafka, Redis).
• Strong SQL skills and experience with modern analytical data lakes and data warehouses.

Responsibilities

• Lead the development and maintenance of scalable data collection systems, ensuring reliable ingestion and data availability for downstream applications.
• Design and manage web scraping infrastructure using residential proxies, TLS fingerprinting, browser automation, and session rotation.
• Build fault-tolerant, high-throughput scraping pipelines for multiple social sources.
• Develop distributed queues and workflow orchestration (Temporal, Ray, Kafka, Celery).
• Architect storage for structured/unstructured data (Parquet, Iceberg, Snowflake, S3).
• Implement monitoring and recovery mechanisms for platform changes and proxy failures.
• Enable downstream AI and analytics workflows via robust data infrastructure.

Tools

Python

Go

Playwright

Puppeteer

Scrapy

Selenium

Temporal

Ray

Apache Kafka

Celery

Redis

Job description

Jobgether SRL in Mexico is seeking a Senior Data Infrastructure Engineer to design and scale high‑performance web scraping and data ingestion systems. This fully remote role focuses on collecting millions of social profiles, posts, and video records daily while addressing anti‑bot challenges and building resilient distributed pipelines.

You will operate at the intersection of data engineering, automation, and AI infrastructure, supporting large‑scale analytics workflows and machine learning