Data Engineer [20261032574]

Beyondsoft Singapore; Singapore; On-site; SGD 90,000 - 130,000; Full time

Job summary

Beyondsoft Singapore is seeking a data engineering specialist to design and maintain robust data pipelines across APIs, files, databases, queues and event services. You will build scheduled jobs, serverless functions, and ETL/ELT workflows with strong data-quality controls.

You will also design APIs and data products for downstream consumers, monitor performance, and implement durable corrective actions. Experience with cloud services and CI/CD is required.

Qualifications

• Degree in Computer Science, Information Systems, Data Engineering or related discipline.
• Relevant cloud or data-engineering certifications are advantageous.
• Minimum 4 years of relevant data-engineering experience.
• Strong SQL and Python or comparable data-engineering language.
• Hands-on experience with cloud data services, serverless compute, object storage, queues and managed databases.
• Experience with ETL/ELT design, APIs, orchestration, data quality and CI/CD.
• Knowledge of near-real-time processing, observability, security and data lifecycle management.
• Experience in AWS is a plus.
• Capability to transition to GCP or equivalent services is preferred.

Responsibilities

• Develop and maintain data ingestion and processing pipelines from APIs, files, databases, queues and event services.
• Build and support scheduled jobs, serverless functions, ETL/ELT workflows and data-quality controls.
• Design, develop, test and publish APIs and data products for downstream consumers.
• Monitor pipeline performance, troubleshoot failures and implement durable corrective actions.
• Maintain data movement, archival, retention and recovery processes.
• Optimise data models, queries, processing efficiency, scalability and maintainability.
• Support cloud migration by mapping existing services to functionally equivalent target-platform components.
• Implement logging, monitoring, alerting, access controls and secure handling of operational data.
• Maintain technical documentation, data mappings, interface specifications and deployment procedures.
• Work with platform and database specialists on capacity, tuning, backup and resilience requirements.

Skills

SQL

Python

Cloud data services

ETL/ELT design

CI/CD

Observability

Near-real-time processing

Education

CS/IS degree

Cloud/data-engineering certifications (advantageous)

Tools

AWS

GCP

Serverless compute

Object storage

Managed databases

Job description

• Develop and maintain data ingestion and processing pipelines from APIs, files, databases, queues and event services.
• Build and support scheduled jobs, serverless functions, ETL/ELT workflows and data-quality controls.
• Design, develop, test and publish APIs and data products for downstream consumers.
• Monitor pipeline performance, troubleshoot failures and implement durable corrective actions.
• Maintain data movement, archival, retention and recovery processes.
• Optimise data models, queries, processing efficiency, scalability and maintainability.
• Support cloud migration by mapping existing services to functionally equivalent target-platform components.
• Implement logging, monitoring, alerting, access controls and secure handling of operational data.
• Maintain technical documentation, data mappings, interface specifications and deployment procedures.
• Work with platform and database specialists on capacity, tuning, backup and resilience requirements.

Responsibilities

• Develop and maintain data ingestion and processing pipelines from APIs, files, databases, queues and event services.
• Build and support scheduled jobs, serverless functions, ETL/ELT workflows and data-quality controls.
• Design, develop, test and publish APIs and data products for downstream consumers.
• Monitor pipeline performance, troubleshoot failures and implement durable corrective actions.
• Maintain data movement, archival, retention and recovery processes.
• Optimise data models, queries, processing efficiency, scalability and maintainability.
• Support cloud migration by mapping existing services to functionally equivalent target-platform components.
• Implement logging, monitoring, alerting, access controls and secure handling of operational data.
• Maintain technical documentation, data mappings, interface specifications and deployment procedures.
• Work with platform and database specialists on capacity, tuning, backup and resilience requirements.

Qualifications

• Degree in Computer Science, Information Systems, Data Engineering or related discipline.
• Relevant cloud or data-engineering certifications are advantageous.
• Minimum 4 years of relevant data-engineering experience.
• Strong SQL and Python or comparable data-engineering language.
• Hands-on experience with cloud data services, serverless compute, object storage, queues and managed databases.
• Experience with ETL/ELT design, APIs, orchestration, data quality and CI/CD.
• Knowledge of near-real-time processing, observability, security and data lifecycle management.
• Experience in AWS is a plus.
• Capability to transition to GCP or equivalent services is preferred.

Other Information

Beyondsoft Consulting (Singapore) Pte. Ltd is committed to being an equal opportunity employer and provides equal employment opportunities to all employees and applicants. We strive to cultivate a workplace that celebrates diversity and inclusion, where individuals of all backgrounds - regardless of nationality, ethnicity, religion, age, gender identity, sexual orientation, or any other distinguishing trait - can succeed and thrive. We prohibit discrimination and harassment of any type with regard to race, color, religion, age, national origin, disability status, genetics, sexual orientation, gender identity, or expression. This policy applies to all terms and conditions of employment, including recruiting, hiring, and the entire employee lifecycle. We are focused on creating an environment where everyone can reach their full potential.

Employment offers from Beyondsoft Consulting (Singapore) Pte. Ltd. are contingent upon the successful completion of any required pre-employment processes, in line with applicable laws and regulations. Beyondsoft Consulting (Singapore) Pte. Ltd. does not ask for any recruitment fees, nor does it request any unauthorized payments from candidates as part of the hiring process.