Cloud Data Engineer: ETL, APIs & Pipelines

Beyondsoft Singapore; Jakarta Pusat; On-site; IDR 300,000,000 - 540,000,000; Full time

Job summary

Beyondsoft is seeking a data engineer to develop and maintain data ingestion pipelines, APIs, and data products for downstream consumers. You will implement robust ETL/ELT workflows, monitoring, and data quality controls while collaborating with cloud and database specialists.

Requirements include strong SQL and Python, hands-on cloud experience (AWS/GCP), and a degree in a relevant field. 3+ years of experience is typical for this role.

Qualifications

• Typically 3+ years of relevant data engineering experience.

Responsibilities

• Develop and maintain data ingestion and processing pipelines from APIs, files, databases, queues and event services.
• Build and support scheduled jobs, serverless functions, ETL/ELT workflows and data quality controls.
• Design, develop, test and publish APIs and data products for downstream consumers.
• Monitor pipeline performance, troubleshoot failures and implement lasting corrective actions.
• Maintain data movement, archival, retention and recovery processes.
• Optimise data models, queries, processing efficiency, scalability and maintainability.
• Support cloud migration by mapping existing services to functionally equivalent target platform components.
• Implement logging, monitoring, alerting, access controls and secure handling of operational data.
• Maintain technical documentation, data mappings, interface specifications and deployment procedures.
• Work with platform and database specialists on capacity, tuning, backup and resilience requirements.

Skills

SQL

Python

ETL/ELT design

APIs

Orchestration

Data quality

CI/CD

Near real time processing

Observability

Security

Data lifecycle management

Serverless compute

Object storage

Managed databases

Education

Bachelor's degree in Computer Science / Information Systems / Data Engineering

Cloud or data engineering certifications

Tools

AWS

GCP

Job description

Beyondsoft is seeking a data engineer to develop and maintain data ingestion pipelines, APIs, and data products for downstream consumers. You will implement robust ETL/ELT workflows, monitoring, and data quality controls while collaborating with cloud and database specialists.

Requirements include strong SQL and Python, hands-on cloud experience (AWS/GCP), and a degree in a relevant field. 3+ years of experience is typical for this role.