Data Engineer [20261032574]

Beyondsoft International (Singapore) Pte Ltd; Singapore; On-site; SGD 90,000 - 150,000; Full time

Job summary

Beyondsoft International (Singapore) Pte. Ltd. is hiring a data engineer to develop and maintain data ingestion pipelines, ETL/ELT workflows and APIs for downstream data products.

The role focuses on ensuring data quality, security, and scalable processing across cloud-based platforms. The ideal candidate will have 4+ years of data engineering experience, strong SQL and Python skills, and experience with AWS.

Qualifications

• Requires a degree in CS/IS/DE or related field.
• Cloud or data-engineering certifications are advantageous.
• Minimum 4 years of relevant data-engineering experience.
• Strong SQL and Python or equivalent.
• Hands-on with cloud data services, serverless compute, object storage, queues & managed databases.
• Experience with ETL/ELT design, APIs, orchestration, data quality & CI/CD.
• Knowledge of near-real-time processing, observability, security & data lifecycle management.
• Experience in AWS is a plus; capability to transition to GCP or equivalent services preferred.

Responsibilities

• Develop and maintain data ingestion and processing pipelines from APIs, files, databases, queues and event services.
• Build and support scheduled jobs, serverless functions, ETL/ELT workflows and data-quality controls.
• Design, develop, test and publish APIs and data products for downstream consumers.
• Monitor pipeline performance, troubleshoot failures and implement durable corrective actions.
• Maintain data movement, archival, retention and recovery processes.
• Optimise data models, queries, processing efficiency, scalability and maintainability.
• Support cloud migration by mapping existing services to functionally equivalent target-platform components.
• Implement logging, monitoring, alerting, access controls and secure handling of operational data.
• Maintain technical documentation, data mappings, interface specifications and deployment procedures.
• Work with platform and database specialists on capacity, tuning, backup and resilience requirements.

Skills

SQL

Python

CI/CD

Observability

Security

Data lifecycle management

Near-real-time processing

Data ingestion

ETL/ELT design

APIs

Education

Bachelor's degree in Computer Science/Information Systems/Data Engineering or related

Cloud or data-engineering certifications advantageous

Tools

AWS

GCP

Cloud data services

Job description

COMPANY DESCRIPTION

Beyondsoft International (Singapore) Pte. Ltd. was set up in 2007 and established as the regional headquarters for the Southeast Asia (SEA) and European markets in September 2015. Based on our vision of "Using technology to promote social progress, economic development and become a global customer preferred partner" and our concept of "Beyond your expectations", Beyondsoft is committed to provide our customers in countries along the "Belt and Road" with comprehensive solutions and products and creating commercial value for customers to realizing continuous businesses development.

Our core business includes:

1. IT development services providing customers with IT consulting, software research and development, software and hardware testing, system integration and operation and maintenance, data analysis and other services;
2. New retail solutions and products through intelligent products, helping small and medium-sized enterprises (SMEs) realize the digital transformation of their daily operations;
3. Internet of Things (IoT) platform and solutions comprehensive use of IoT, artificial intelligence, big data, cloud computing and other technologies to provide IoT solutions for intelligent upgrades in cities, parks, buildings and industries, to create a smart future.

For more information, please visit www.beyondsoft.com.

RESPONSIBILITIES

• Develop and maintain data ingestion and processing pipelines from APIs, files, databases, queues and event services.
• Build and support scheduled jobs, serverless functions, ETL/ELT workflows and data-quality controls.
• Design, develop, test and publish APIs and data products for downstream consumers.
• Monitor pipeline performance, troubleshoot failures and implement durable corrective actions.
• Maintain data movement, archival, retention and recovery processes.
• Optimise data models, queries, processing efficiency, scalability and maintainability.
• Support cloud migration by mapping existing services to functionally equivalent target-platform components.
• Implement logging, monitoring, alerting, access controls and secure handling of operational data.
• Maintain technical documentation, data mappings, interface specifications and deployment procedures.
• Work with platform and database specialists on capacity, tuning, backup and resilience requirements.

QUALIFICATIONS

• Degree in Computer Science, Information Systems, Data Engineering or related discipline.
• Relevant cloud or data-engineering certifications are advantageous.
• Minimum 4 years of relevant data-engineering experience.
• Strong SQL and Python or comparable data-engineering language.
• Hands-on experience with cloud data services, serverless compute, object storage, queues and managed databases.
• Experience with ETL/ELT design, APIs, orchestration, data quality and CI/CD.
• Knowledge of near-real-time processing, observability, security and data lifecycle management.
• Experience in AWS is a plus.
• Capability to transition to GCP or equivalent services is preferred.