Junior Data Engineer [20261042355]

HYPERSCAL SOLUTIONS PTE. LTD.; Dublin; On-site; EUR 65,000 - 90,000; Full time

Job summary

Beyondsoft International offers a data engineering role focused on building and maintaining batch and streaming data pipelines. You will map, transform and validate data, support scheduled workflows and monitor pipelines, and help deploy workloads in containerised environments.

Join a team that values data quality, Agile practices and modern tech like Spark, Kafka and Airflow to enable scalable data solutions across markets.

Qualifications

• Minimum 2 years of experience in data engineering or backend development.
• Familiarity with Agile development methodologies.
• Working knowledge of SQL and Java or Scala.
• Basic experience with Apache Spark, Apache Flink or Apache Kafka.
• Familiarity with Kubernetes, Docker and S3-compatible object storage.
• Experience with data mapping, transformation, validation and scheduled workflows.
• Familiarity with the SAFe framework.
• Exposure to MinIO or equivalent S3-compatible storage solutions.
• Familiarity with relational databases, Git, CI/CD and automated testing.
• Exposure to Apache Airflow or equivalent workflow orchestration tools.
• Knowledge of batch and stream-processing technologies.

Responsibilities

• Develop and maintain batch and streaming data pipelines.
• Perform data mapping, transformation and validation.
• Support scheduled data workflows and pipeline monitoring.
• Assist in deploying and maintaining data workloads in containerised environments.
• Troubleshoot data pipeline issues and support defect resolution.
• Work with the team to maintain data quality and support CI/CD processes.

Skills

Batch processing

Stream processing

SQL

Java/Scala

Apache Spark

Apache Kafka

Apache Flink

Kubernetes

Docker

S3 storage

MinIO

Git

CI/CD

Airflow

Agile

Relational DBs

Education

Tools

Kubernetes

Docker

S3-compatible storage

MinIO

Git

CI/CD

Apache Airflow

Job description

COMPANY DESCRIPTION

Beyondsoft International (Singapore) Pte. Ltd. was set up in 2007 and established as the regional headquarters for the Southeast Asia (SEA) and European markets in September 2015. Based on our vision of "Using technology to promote social progress, economic development and become a global customer preferred partner" and our concept of "Beyond your expectations", Beyondsoft is committed to provide our customers in countries along the "Belt and Road" with comprehensive solutions and products and creating commercial value for customers to realizing continuous businesses development.

Our core business includes:

1. IT development services providing customers with IT consulting, software research and development, software and hardware testing, system integration and operation and maintenance, data analysis and other services;
2. New retail solutions and products through intelligent products, helping small and medium‑size enterprises (SMEs) realize the digital transformation of their daily operations;
3. Internet of Things (IoT) platform and solutions comprehensive use of IoT, artificial intelligence, big data, cloud computing and other technologies to provide IoT solutions for intelligent upgrades in cities, parks, buildings and industries, to create a smart future.

For more information, please visit www.beyondsoft.com.

RESPONSIBILITIES

• Develop and maintain batch and streaming data pipelines.

• Perform data mapping, transformation and validation.

• Support scheduled data workflows and pipeline monitoring.

• Assist in deploying and maintaining data workloads in containerised environments.

• Troubleshoot data pipeline issues and support defect resolution.

• Work with the team to maintain data quality and support CI/CD processes.

QUALIFICATIONS

• Minimum 2 years of experience in data engineering or backend development.

• Familiarity with Agile development methodologies.

• Working knowledge of SQL and Java or Scala.

• Basic experience with Apache Spark, Apache Flink or Apache Kafka.

• Familiarity with Kubernetes, Docker and S3-compatible object storage.

• Experience with data mapping, transformation, validation and scheduled workflows.

• Familiarity with the SAFe framework.

• Exposure to MinIO or equivalent S3-compatible storage solutions.

• Familiarity with relational databases, Git, CI/CD and automated testing.

• Exposure to Apache Airflow or equivalent workflow orchestration tools.

• Knowledge of batch and stream-processing technologies.

OTHER INFORMATION

Beyondsoft Consulting (Singapore) Pte. Ltd is committed to being an equal opportunity employer and provides equal employment opportunities to all employees and applicants. We strive to cultivate a workplace that celebrates diversity and inclusion, where individuals of all backgrounds—regardless of nationality, ethnicity, religion, age, gender identity, sexual orientation, or any other distinguishing trait—can succeed and thrive. We prohibit discrimination and harassment of any type with regard to race, color, religion, age, national origin, disability status, genetics, sexual orientation, gender identity, or expression. This policy applies to all terms and conditions of employment, including recruiting, hiring, and the entire employee lifecycle. We are focused on creating an environment where everyone can reach their full potential.

Employment offers from Beyondsoft Consulting (Singapore) Pte. Ltd. are contingent upon the successful completion of any required pre-employment processes, in line with applicable laws and regulations. Beyondsoft Consulting (Singapore) Pte. Ltd. does not ask for any recruitment fees, nor does it request any unauthorized payments from candidates as part of the hiring process.

Please note that your application will be sent to and reviewed by the direct employer - Beyondsoft Consulting (Singapore) Pte Ltd