Senior Data Acquisition Engineer - Web Crawling & AI

Joom

Lisboa

Hybrid

EUR 70,000 - 100,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Compensation package: base salary and绩
Office-first: flexible hours with the
Health insurance, meal allowance, sick

Job summary

JoomPulse, the AI analytics tool from Joom Group in Portugal, seeks a Senior Data Acquisition Engineer to own data pipelines for scraping marketplaces like Mercado Livre and Shopee. You’ll build distributed crawlers, reverse‑engineer private APIs, and scale systems with Redis/Kafka, while experimenting with LLMs and tools to solve hard anti‑bot challenges.

You will work with a global team across Portugal, Brazil, Latvia and China, enjoy flexible hours with remote options a portion of time, and

Qualifications

  • 3+ years building distributed crawlers in production.
  • Strong Python (Scrapy/Playwright) or Node.js (Puppeteer/Crawlee).
  • Experience with proxy infrastructure and rotating proxies.
  • Reverse engineering private APIs via mitmproxy/Charles/Burp.
  • Scaling crawlers on distributed queues (Redis, Kafka or SQS).
  • English fluency for daily international teamwork.

Responsibilities

  • Own and develop the scraping of Mercado Livre, the main data source behind JoomPulse, and extend it to new marketplaces such as Shopee
  • Build and maintain distributed crawlers running in production
  • Monitor target marketplaces for changes, detect them early and update bypass logic proactively
  • Reverse engineer private APIs to get data faster and more reliably than through HTML
  • Keep crawlers scalable and observable: distributed queues, success-rate monitoring, alerting on anti-bot regressions
  • Investigate pipeline failures caused by new anti-bot checks and restore the data flow
  • Use LLMs and any other tooling to research and solve problems that have no ready answers
  • Spot data that can be useful for the product and bring these insights to the team

Skills

Distributed crawlers
Python
Node.js
English communication

Tools

Scrapy
Playwright
Puppeteer
Crawlee
mitmproxy
Charles
Burp
Redis
Kafka
SQS

Job description

JoomPulse, the AI analytics tool from Joom Group in Portugal, seeks a Senior Data Acquisition Engineer to own data pipelines for scraping marketplaces like Mercado Livre and Shopee. You’ll build distributed crawlers, reverse‑engineer private APIs, and scale systems with Redis/Kafka, while experimenting with LLMs and tools to solve hard anti‑bot challenges.

You will work with a global team across Portugal, Brazil, Latvia and China, enjoy flexible hours with remote options a portion of time, and

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Acquisition Engineer at JoomPulse
Senior Data Acquisition Engineer at JoomPulse

Joom • Lisboa

Hybrid
EUR 70,000 - 100,000
Compensation package: base salary and绩
Office-first: flexible hours with the
Health insurance, meal allowance, sick
Senior Product Analyst
Senior Product Analyst

Joom • Lisboa

Hybrid
EUR 65,000 - 90,000
Salary bonus
Remote work options
Health insurance
+6
Senior Product Analyst At Joompulse
Senior Product Analyst At Joompulse

Joom • Lisboa

Hybrid
EUR 65,000 - 90,000
Health insurance (including dental)
Meal allowance
Paid sick leave
+3
AI-Driven Marketing Data Analyst
AI-Driven Marketing Data Analyst

Joom • Lisboa

Hybrid
EUR 60,000 - 90,000
Relocation to Lisbon
Health insurance
Hybrid/remote flexibility
+2
Senior Ml Engineer
Senior Ml Engineer

Joom • Lisboa

Hybrid
EUR 45,000 - 75,000
Health insurance including dental care
Flexible hours
Performance-based bonuses
+2
Senior Growth Manager At Joomai
Senior Growth Manager At Joomai

Joom • Lisboa

Hybrid
EUR 70,000 - 110,000
Flexible hours
Remote days
Paid leave
+3
Senior Growth Manager – AI Powered Platform (Remote)
Senior Growth Manager – AI Powered Platform (Remote)

Joom • Lisboa

Hybrid
EUR 70,000 - 110,000
Flexible hours
Remote days
Paid leave
+3
Senior Growth Manager, AI-Powered Marketplace Growth
Senior Growth Manager, AI-Powered Marketplace Growth

Growth Jobs • Lisboa

Hybrid
EUR 70,000 - 90,000
Base salary plus performance bonuses
Extended health insurance including-d+
30 days paid annual leave
+3
Marketing Data Analyst (to Lisbon, Portugal)
Marketing Data Analyst (to Lisbon, Portugal)

Joom • Lisboa

Hybrid
EUR 42,000 - 54,000
Relocation support
Flexible hours
Health insurance
+2
Senior Growth Manager at JoomAI
Senior Growth Manager at JoomAI

Growth Jobs • Lisboa

Hybrid
EUR 70,000 - 90,000
Base salary plus performance bonuses
Extended health insurance including-d+
30 days paid annual leave
+3
Top locations