Data Engineer: Cloud Pipelines, ETL & Observability

Beyondsoft International (Singapore) Pte Ltd; Singapore; On-site; SGD 90,000 - 150,000; Full time

Job summary

Beyondsoft International (Singapore) Pte. Ltd. is hiring a data engineer to develop and maintain data ingestion pipelines, ETL/ELT workflows and APIs for downstream data products.

The role focuses on ensuring data quality, security, and scalable processing across cloud-based platforms. The ideal candidate will have 4+ years of data engineering experience, strong SQL and Python skills, and experience with AWS.

Qualifications

• Requires a degree in CS/IS/DE or related field.
• Cloud or data-engineering certifications are advantageous.
• Minimum 4 years of relevant data-engineering experience.
• Strong SQL and Python or equivalent.
• Hands-on with cloud data services, serverless compute, object storage, queues & managed databases.
• Experience with ETL/ELT design, APIs, orchestration, data quality & CI/CD.
• Knowledge of near-real-time processing, observability, security & data lifecycle management.
• Experience in AWS is a plus; capability to transition to GCP or equivalent services preferred.

Responsibilities

• Develop and maintain data ingestion and processing pipelines from APIs, files, databases, queues and event services.
• Build and support scheduled jobs, serverless functions, ETL/ELT workflows and data-quality controls.
• Design, develop, test and publish APIs and data products for downstream consumers.
• Monitor pipeline performance, troubleshoot failures and implement durable corrective actions.
• Maintain data movement, archival, retention and recovery processes.
• Optimise data models, queries, processing efficiency, scalability and maintainability.
• Support cloud migration by mapping existing services to functionally equivalent target-platform components.
• Implement logging, monitoring, alerting, access controls and secure handling of operational data.
• Maintain technical documentation, data mappings, interface specifications and deployment procedures.
• Work with platform and database specialists on capacity, tuning, backup and resilience requirements.

Skills

SQL

Python

CI/CD

Observability

Security

Data lifecycle management

Near-real-time processing

Data ingestion

ETL/ELT design

APIs

Education

Bachelor's degree in Computer Science/Information Systems/Data Engineering or related

Cloud or data-engineering certifications advantageous

Tools

AWS

GCP

Cloud data services

Job description

Beyondsoft International (Singapore) Pte. Ltd. is hiring a data engineer to develop and maintain data ingestion pipelines, ETL/ELT workflows and APIs for downstream data products.

The role focuses on ensuring data quality, security, and scalable processing across cloud-based platforms. The ideal candidate will have 4+ years of data engineering experience, strong SQL and Python skills, and experience with AWS.