Job Overview
Gi Group Mèxico, part of the global Gi Group Holding, is looking for a Web Scraping Engineer (Crawler). This 100% digital role is based in or near CDMX and offers full flexibility.
Responsibilities
- Design, build, and optimize large‑scale automated data collection and storage systems.
- Master and enhance Lex Machina’s crawling infrastructure to support customer‑facing applications.
- Extract and process large datasets from industries such as retail pricing, neobanks, and airlines or OTAs.
- Debug, troubleshoot, and optimize crawlers for maximum performance and accuracy.
- Collaborate with cross‑functional teams to align data collection processes with business goals.
- Create and maintain comprehensive documentation of crawling infrastructure and processes.
- Communicate effectively with stakeholders by asking and answering questions, addressing issues, and providing detailed updates.
Qualifications
- Bachelor’s degree in Computer Science or related field.
- 3‑5+ years of backend software engineering experience, focused on Python in challenging environments.
- Proven expertise in large‑scale data collection, processing, and storage systems.
- Strong problem‑solving skills with an enthusiasm for detail and mastery of technical systems.
- Excellent communication skills, including thorough documentation and the ability to ask/answer questions diligently.
- Self‑motivated, with a passion for delivering high‑quality work that supports customer‑facing products.
Preferred Qualifications
- Experience with distributed systems and scalable architecture.
- Knowledge of modern software development practices such as CI/CD and Agile methodologies.
- Familiarity with cloud environments such as AWS or Azure.
- Advanced English at least B2.
Soft Skills
- Strong communication skills, with the ability to align the organization around complex technical decisions.
- Active coach and mentor whose goal is to develop and maximize the team’s potential.
- Proactivity and passion for the client.
Benefits and Culture
- Competitive salary in a fully digital environment.
- Inclusive, transparent work culture with high impact projects.
- 100% Payroll with law and superior benefits.
- Diversity and inclusion: 100% support for all genders, ethnicities, religions, abilities, and talents.
Contract Type
100% Payroll with law and superior benefits.
EEO Statement
Gi Group Mèxico is an equal opportunity employer and supports a diverse and inclusive workforce.