Junior Data Engineer [20261042355]

Beyondsoft Singapore; Singapore; On-site; SGD 60,000 - 90,000; Full time

Job summary

Beyondsoft Singapore is hiring a Data Engineer to develop and maintain batch and streaming data pipelines, perform data mapping, transformation and validation, and monitor scheduled workflows.

You will deploy and maintain data workloads in containerised environments, troubleshoot issues, and collaborate with the team to uphold data quality and CI/CD practices. Candidates should have 2+ years in data engineering or backend roles with SQL and Java/Scala, plus Spark, Flink or Kafka experience.

Qualifications

• 2+ years of experience in data engineering or backend development.
• Familiarity with Agile development methodologies.
• Working knowledge of SQL and Java or Scala.
• Basic experience with Apache Spark, Apache Flink or Apache Kafka.
• Familiarity with Kubernetes, Docker and S3-compatible object storage.
• Experience with data mapping, transformation, validation and scheduled workflows.
• Familiarity with the SAFe framework.
• Exposure to MinIO or equivalent S3-compatible storage solutions.
• Familiarity with relational databases, Git, CI/CD and automated testing.
• Exposure to Apache Airflow or equivalent workflow orchestration tools.

Responsibilities

• Develop and maintain batch and streaming data pipelines.
• Perform data mapping, transformation and validation.
• Support scheduled data workflows and pipeline monitoring.
• Assist in deploying and maintaining data workloads in containerised environments.
• Troubleshoot data pipeline issues and support defect resolution.
• Work with the team to maintain data quality and support CI/CD processes.

Skills

SQL

Java or Scala

Airflow

Kubernetes

Docker

CI/CD

Data pipelines

Tools

Spark

Flink

Kafka

MinIO

S3-compatible storage

Job description

• Develop and maintain batch and streaming data pipelines.


• Perform data mapping, transformation and validation.


• Support scheduled data workflows and pipeline monitoring.


• Assist in deploying and maintaining data workloads in containerised environments.


• Troubleshoot data pipeline issues and support defect resolution.


• Work with the team to maintain data quality and support CI/CD processes.

Responsibilities

• Develop and maintain batch and streaming data pipelines.


• Perform data mapping, transformation and validation.


• Support scheduled data workflows and pipeline monitoring.


• Assist in deploying and maintaining data workloads in containerised environments.


• Troubleshoot data pipeline issues and support defect resolution.


• Work with the team to maintain data quality and support CI/CD processes.

Qualifications

• Minimum 2 years of experience in data engineering or backend development.


• Familiarity with Agile development methodologies.


• Working knowledge of SQL and Java or Scala.


• Basic experience with Apache Spark, Apache Flink or Apache Kafka.


• Familiarity with Kubernetes, Docker and S3-compatible object storage.


• Experience with data mapping, transformation, validation and scheduled workflows.


• Familiarity with the SAFe framework.


• Exposure to MinIO or equivalent S3-compatible storage solutions.


• Familiarity with relational databases, Git, CI/CD and automated testing.


• Exposure to Apache Airflow or equivalent workflow orchestration tools.


• Knowledge of batch and stream-processing technologies.

Other Information

Beyondsoft Consulting (Singapore) Pte. Ltd is committed to being an equal opportunity employer and provides equal employment opportunities to all employees and applicants. We strive to cultivate a workplace that celebrates diversity and inclusion, where individuals of all backgrounds—regardless of nationality, ethnicity, religion, age, gender identity, sexual orientation, or any other distinguishing trait—can succeed and thrive. We prohibit discrimination and harassment of any type with regard to race, color, religion, age, national origin, disability status, genetics, sexual orientation, gender identity, or expression. This policy applies to all terms and conditions of employment, including recruiting, hiring, and the entire employee lifecycle. We are focused on creating an environment where everyone can reach their full potential.

Employment offers from Beyondsoft Consulting (Singapore) Pte. Ltd. are contingent upon the successful completion of any required pre-employment processes, in line with applicable laws and regulations. Beyondsoft Consulting (Singapore) Pte. Ltd. does not ask for any recruitment fees, nor does it request any unauthorized payments from candidates as part of the hiring process.