Data Acquisition Platform Engineer

Astro Holdings Berhad

Jakarta Pusat

On-site

IDR 167,400,000 - 390,600,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Astro Holdings Berhad in Jakarta is seeking a Python-focused software engineer to design and maintain scalable web crawlers, scrapers, and external API integrations across ecommerce and retail sources. You will build acquisition systems that stay reliable as websites and APIs evolve, handle sessions, pagination, tokens, and rate limits, and ensure robust testing and monitoring.

Collaborate with Pricing and Data teams to turn external-data needs into enduring platform capabilities using cloud

Qualifications

  • Strong Python and software engineering fundamentals.
  • Hands-on experience building or operating data acquisition systems.
  • Understanding of production reliability patterns such as retry, timeout, rate limiting, concurrency, and failure recovery.
  • Solid knowledge of SQL, data storage/warehousing, schema evolution, workflow orchestration, containerized workloads, and cloud infrastructure fundamentals.

Responsibilities

  • Build and maintain reliable web/app crawlers, scrapers, and external API integrations across e-commerce, marketplace, retail, and other external sources.
  • Build acquisition systems that remain reliable as external websites, applications, APIs, and data contracts evolve.
  • Handle real-world source complexity such as sessions, tokens, pagination, dynamic content, rate limits, retries, concurrency, and partial failures.
  • Build resilient and maintainable acquisition systems with appropriate testing, idempotency, deduplication, retries, safe reruns, data-quality validation, monitoring, and alerting.
  • Operate acquisition workloads using appropriate workflow orchestration, compute, data storage/warehousing, and cloud infrastructure.
  • Continuously improve reliability, scalability, maintainability, and total cost of ownership, including evaluating build-vs-buy approaches for external data.
  • Explore new technologies and AI-assisted development or automation to improve how external-data pipelines are built, operated, and maintained.
  • Collaborate with Pricing, Data Warehouse Engineering, Data Analysts, and other stakeholders to turn external-data needs into sustainable platform capabilities.

Skills

Python
Software engineering fundamentals
Reliability patterns
Troubleshooting
Production systems

Tools

SQL
Docker
Cloud infrastructure

Job description

Astro Holdings Berhad in Jakarta is seeking a Python-focused software engineer to design and maintain scalable web crawlers, scrapers, and external API integrations across ecommerce and retail sources. You will build acquisition systems that stay reliable as websites and APIs evolve, handle sessions, pagination, tokens, and rate limits, and ensure robust testing and monitoring.

Collaborate with Pricing and Data teams to turn external-data needs into enduring platform capabilities using cloud

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Platform Engineer — External Data Acquisition
Data Platform Engineer — External Data Acquisition

Astro Indonesia • Jakarta Barat

On-site
IDR 350,000,000 - 700,000,000
Data Platform Engineer
Data Platform Engineer

Astro Indonesia • Jakarta Barat

On-site
IDR 350,000,000 - 700,000,000
Data Platform Engineer
Data Platform Engineer

Astro Holdings Berhad • Jakarta Pusat

On-site
IDR 167,400,000 - 390,600,000
Senior Backend Engineer (Golang, Scalable Systems)
Senior Backend Engineer (Golang, Scalable Systems)

ASTRO • Jakarta Pusat

On-site
IDR 400,000,000 - 900,000,000
Senior Backend Engineer
Senior Backend Engineer

ASTRO • Jakarta Pusat

On-site
IDR 400,000,000 - 900,000,000
AI Software Engineer: Full-Stack & ML Solutions
AI Software Engineer: Full-Stack & ML Solutions

BECA • Jakarta Pusat

On-site
IDR 150,000,000 - 280,000,000
Data Engineer: Build ETL Pipelines & API Integrations
Data Engineer: Build ETL Pipelines & API Integrations

AME Research • Jakarta Pusat

On-site
IDR 250,000,000 - 450,000,000
Modern office near public transport
Competitive salary
Senior Software Engineer, AI-Driven Fullstack & Systems
Senior Software Engineer, AI-Driven Fullstack & Systems

Grab • Jakarta Pusat

On-site
IDR 700,000,000 - 900,000,000
Term Life Insurance
Medical Insurance
GrabFlex
+5
Senior Data Engineer - Jakarta
Senior Data Engineer - Jakarta

PT Bibit Tumbuh Bersama • Jakarta Utara

On-site
IDR 240,000,000 - 480,000,000
Data & Integrations Developer – Indonesia
Data & Integrations Developer – Indonesia

PS Global Consulting • Indonesia

On-site
IDR 89,280,000 - 167,400,000