Data Engineer

AME Research; Jakarta Pusat; On-site; IDR 250,000,000 - 450,000,000; Full time

Benefits offered by this job

Modern office near public transport

Competitive salary

Job summary

AME Research in Jakarta is seeking a Data Engineer to design, implement, and maintain reliable data pipelines that collect and process data from various public APIs into a centralised blob storage and database environment.

You will ensure data is ingested efficiently and transformed cleanly for downstream analysis and reporting, collaborating with data scientists and developers in an in-office setting.

Qualifications

• Bachelor's degree in a related field or equivalent experience.
• 3+ years of experience building data pipelines in a production environment.
• Strong understanding of ETL/ELT architecture, API data ingestion, and data modelling principles.
• Experience with Azure and cloud-based data ecosystems.

Responsibilities

• Design and implement ETL/ELT pipelines to ingest data from multiple public APIs into blob storage and relational databases.
• Build and manage scheduled workflows using Apache Airflow (or similar).
• Handle complex API integrations, authentication flows (OAuth2, API keys), pagination, and rate limiting.
• Structure data in blob storage (e.g., Azure Blob) for efficient downstream access.
• Transform and load data into structured SQL-based databases for analytics and access by Web applications.
• Implement monitoring, logging, and validation to ensure data integrity and pipeline reliability.
• Work closely with data scientists and software developers to ensure data availability and usability.
• Maintain clear documentation for data sources, transformations, and orchestration logic.

Skills

Python

SQL

Azure

ETL/ELT

Airflow

Education

Bachelor's degree in Computer Science, Data Engineering

Tools

Azure Blob Storage

Git

CI/CD pipelines

Apache Airflow

Job description

About The Role

We're looking for a Data Engineer to design, implement, and maintain reliable data pipelines that collect and process data from various public APIs into a centralised blob storage and database environment. You'll play a key role in ensuring data is ingested efficiently, transformed cleanly, and made accessible for downstream analysis and reporting.

Home

> Careers

> Data Engineer

Data Engineer

09 Dec 2025

Location: Jakarta

Position Type: Full-time (in office)

Reports to: CTO

About The Role

We're looking for a Data Engineer to design, implement, and maintain reliable data pipelines that collect and process data from various public APIs into a centralised blob storage and database environment. You'll play a key role in ensuring data is ingested efficiently, transformed cleanly, and made accessible for downstream analysis and reporting.

Key Responsibilities

• Design and implement robust ETL/ELT pipelines to extract data from multiple public APIs and load into blob storage and relational databases.
• Build and manage scheduled workflows using tools such as Apache Airflow (or similar).
• Handle complex API integrations, authentication flows (OAuth2, API keys), pagination, and rate limiting.
• Structure data in blob storage (e.g., Azure Blob) for efficient downstream access.
• Transform and load data into structured SQL-based databases for analytics and access by Web applications
• Implement monitoring, logging, and validation to ensure data integrity and pipeline reliability.
• Work closely with data scientists, and software developers to ensure data availability and usability.
• Maintain clear documentation for data sources, transformations, and orchestration logic.

Qualifications

• Bachelor's degree in Computer Science, Data Engineering, or a related field (or equivalent experience).
• 3+ years of experience building data pipelines in a production environment.
• Strong understanding of ETL/ELT architecture, API data ingestion, and data modelling principles.
• Experience with Azure

Technical Skills

• Languages: Python (preferred), SQL (Microsoft T-SQL)
• Orchestration: Apache Airflow or similar
• RESTful API integration (authentication, pagination, error handling)
• Azure Blob Storage
• Familiarity with version control (Git) and CI/CD pipelines

Nice To Have

• Experience integrating data from open economic and financial APIs (e.g., World Bank, IMF, OECD, UN Data, FRED)
• Familiarity with large structured and semi-structured datasets (JSON, CSV, Parquet) and associated performance considerations
• Experience building incremental ingestion or change data capture (CDC) pipelines

Soft Skills

• Strong analytical and problem-solving mindset
• Clear communication of technical concepts to non-technical stakeholders
• Attention to detail and data accuracy
• Proactive approach to monitoring

What We Offer

• Modern, central office near to public transport and key amenities
• Competitive salary