Senior Data Engineer, Web Scraping (Remote)

Jobgether; México; A distancia; MXN 800.000 - 1.400.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Fully remote position

Full-time opportunity

Autonomy and ownership

Work on advanced web-scraping & data-­

Collaborative engineering team

Descripción de la vacante

Jobgether is assisting a partner to hire a Senior Data Engineer - Web Scraping based in Mexico. This fully remote role focuses on designing and maintaining advanced web scrapers, transforming diverse sources into reliable datasets, and building scalable data pipelines using Python, Pandas, SQL, and Airflow.

The ideal candidate will have 4–6 years of data engineering experience, strong web-scraping expertise (Selenium, Scrapy, XPath), and a solid understanding of HTML/JS/APIs.

Formación

• Bachelor's or master's degree in Computer Science, Engineering, or a related technical discipline.
• 4–6 years of professional experience in data engineering or a closely related field.
• Strong programming skills in Python and strong knowledge of SQL and database technologies.
• Advanced hands-on expertise with the Python Pandas library for data cleaning, manipulation, exploration, and transformation.
• Strong web-scraping experience with Selenium, Scrapy, Fiddler, Postman, and XPath.
• Strong experience with Apache Airflow for workflow orchestration and data pipeline management.
• Solid understanding of web technologies, including HTML, JavaScript, APIs, and related concepts.
• Proven experience working with large datasets and performing data cleaning, transformation, manipulation, and replacement.

Responsabilidades

• Design, develop, deploy, and maintain web scrapers using a range of scraping techniques and tools to collect alternative datasets from diverse sources.
• Use Python and Pandas to clean, explore, transform, manipulate, and prepare large datasets for downstream consumption.
• Build and maintain efficient data pipelines that ingest scraped data into databases and data warehouses.
• Develop and manage scheduled workflows using Apache Airflow and other orchestration tools to ensure reliable and timely data delivery.
• Collaborate with analysts and cross-functional stakeholders to understand current and anticipated data requirements and translate them into effective technical solutions.
• Develop quality-control checks to validate data availability, accuracy, consistency, and integrity.
• Maintain alerting systems, investigate time-sensitive data incidents, and resolve operational issues to ensure reliable day-to-day data delivery.
• Design and implement tools, applications, and automation that improve the capabilities and efficiency of the web-scraping platform.
• Contribute to infrastructure and data-product design, bringing practical solutions that support data scientists and other technology teams.
• Work independently while collaborating with engineering, product, and technology stakeholders to deliver high-quality solutions and continuously improve existing systems.

Conocimientos

Python

SQL

Pandas

Web scraping

Data pipelines

Airflow

Docker

Kubernetes

GitHub Actions

Jenkins

AWS

Selenium

Scrapy

XPath

Postman

Fiddler

APIs

HTML/JavaScript

Educación

Bachelor's or Master's in CS/Engineering

Herramientas

SQL

Descripción del empleo

Jobgether is assisting a partner to hire a Senior Data Engineer - Web Scraping based in Mexico. This fully remote role focuses on designing and maintaining advanced web scrapers, transforming diverse sources into reliable datasets, and building scalable data pipelines using Python, Pandas, SQL, and Airflow.

The ideal candidate will have 4–6 years of data engineering experience, strong web-scraping expertise (Selenium, Scrapy, XPath), and a solid understanding of HTML/JS/APIs.