Data Engineer

Beyondsoft Singapore; Jakarta Pusat; On-site; IDR 300,000,000 - 540,000,000; Full time

Job summary

Beyondsoft is seeking a data engineer to develop and maintain data ingestion pipelines, APIs, and data products for downstream consumers. You will implement robust ETL/ELT workflows, monitoring, and data quality controls while collaborating with cloud and database specialists.

Requirements include strong SQL and Python, hands-on cloud experience (AWS/GCP), and a degree in a relevant field. 3+ years of experience is typical for this role.

Qualifications

• Typically 3+ years of relevant data engineering experience.

Responsibilities

• Develop and maintain data ingestion and processing pipelines from APIs, files, databases, queues and event services.
• Build and support scheduled jobs, serverless functions, ETL/ELT workflows and data quality controls.
• Design, develop, test and publish APIs and data products for downstream consumers.
• Monitor pipeline performance, troubleshoot failures and implement lasting corrective actions.
• Maintain data movement, archival, retention and recovery processes.
• Optimise data models, queries, processing efficiency, scalability and maintainability.
• Support cloud migration by mapping existing services to functionally equivalent target platform components.
• Implement logging, monitoring, alerting, access controls and secure handling of operational data.
• Maintain technical documentation, data mappings, interface specifications and deployment procedures.
• Work with platform and database specialists on capacity, tuning, backup and resilience requirements.

Skills

SQL

Python

ETL/ELT design

APIs

Orchestration

Data quality

CI/CD

Near real time processing

Observability

Security

Data lifecycle management

Serverless compute

Object storage

Managed databases

Education

Bachelor's degree in Computer Science / Information Systems / Data Engineering

Cloud or data engineering certifications

Tools

AWS

GCP

Job description

• Develop and maintain data ingestion and processing pipelines from APIs, files, databases, queues and event services.
• Build and support scheduled jobs, serverless functions, ETL/ELT workflows and data quality controls.
• Design, develop, test and publish APIs and data products for downstream consumers.
• Monitor pipeline performance, troubleshoot failures and implement lasting corrective actions.
• Maintain data movement, archival, retention and recovery processes.
• Optimise data models, queries, processing efficiency, scalability and maintainability.
• Support cloud migration by mapping existing services to functionally equivalent target platform components.
• Implement logging, monitoring, alerting, access controls and secure handling of operational data.
• Maintain technical documentation, data mappings, interface specifications and deployment procedures.
• Work with platform and database specialists on capacity, tuning, backup and resilience requirements.

Requirements:

• Strong SQL and Python or a comparable data engineering language.
• Hands on experience with cloud data services, serverless compute, object storage, queues and managed databases.
• Experience with ETL/ELT design, APIs, orchestration, data quality and CI/CD.
• Knowledge of near real time processing, observability, security and data lifecycle management.
• Experience in AWS is useful. Ability to move to GCP or equivalent services is preferred.
• Degree in Computer Science, Information Systems, Data Engineering or a related discipline.
• Relevant cloud or data engineering certifications are advantageous.
• Typically, 3 years or more of relevant data engineering experience.

Beyondsoft is committed to being an equal opportunity employer and provides equal employment opportunities to all employees and applicants. We strive to cultivate a workplace that celebrates diversity and inclusion, where individuals of all backgrounds—regardless of nationality, ethnicity, religion, age, gender identity, sexual orientation, or any other distinguishing trait—can succeed and thrive. We prohibit discrimination and harassment of any type with regard to race, color, religion, age, national origin, disability status, genetics, sexual orientation, gender identity, or expression. This policy applies to all terms and conditions of employment, including recruiting, hiring, and the entire employee lifecycle. We are focused on creating an environment where everyone can reach their full potentetl

Employment offers from Beyondsoft are contingent upon the successful completion of any required pre-employment processes, in line with applicable laws and regulations. Beyondsoft does not ask for any recruitment fees, nor does it request any unauthorized payments from candidates as part of the hiring pro cess.