Data Engineer (AMK)

MAESTRO HUMAN RESOURCE PTE. LTD.; Singapore; On-site; SGD 60,000 - 80,000; Full time

Job summary

A leading technology company in Singapore is seeking an aspiring Data Engineer/Software Developer to build data integration pipelines and participate in product development. The ideal candidate will have a Bachelor's or Master's degree in a related field and be proficient in SQL and Java. You will collaborate with a skilled team to improve product quality and manage data effectively. This role offers a five-day work week in the AMK area.

Qualifications

• Bachelor's/Master's in Computer Science, Engineering or related field.
• Proficiency in at least one object-oriented language like Java.
• Experience with data lifecycle management and analytics.

Responsibilities

• Collaborate with teams in software delivery.
• Develop scalable data models and schemas.
• Implement event-driven processing pipelines.

Skills

Data manipulation languages (SQL)

Java programming

Event-driven architecture

Communication skills

Problem-solving skills

Education

Bachelor's or Master's in Computer Science/Engineering

Tools

Apache Kafka

Solace Pubsub

MQTT

AMQP

Job description

Job Description & Requirements

We are looking for aspiring Data Engineer/Software Developer to join our product development team, you will be responsible for the design and implementation of data integration pipeline and asynchronous data event using event driven architecture approach to consolidate data from various sources and systems.

About the Role

• Collaborating with a team of highly skilled Software Engineers and Data Engineers in deploying and delivering software products.Actively participating in product enhancement, particularly in the areas of integration and UI, to improve product quality and reconfigurability.
• Taking ownership of the development of key software components.
• Design, develop and maintain scalable data models and schemas using various data modelling best practices.
• Design and develop integration connectors to facilitate data integration from multiple sources and systems, including databases, APIs, log files, streaming platforms, IoT end devices and external data providers.
• Data Transformation and Processing: Develop data transformation routines to clean, normalize, and aggregate data. Apply data processing techniques to handle complex data structures, handle missing or inconsistent data, and prepare the data for analysis or reporting.
• Strong knowledge of data manipulation languages such as SQL necessary to build and maintain complex queries and data pipelines.
• Implement event-driven processing pipelines using frameworks like Solace Pubsub, Apache Kafka, MQTT, AMQP.
• Ensure compliance to data governance policies and standards to ensure data quality, integrity, security and consistency.
• Experience working in a dynamic environment with managing senior stakeholders from different organisations and agencies.

Requirements

• Bachelor's/Master's degree specializing in Computer Science / Engineering / Industrial Engineering or related field. Diploma holders with relevant experience are encouraged to apply.
• Proficiency in at least one object-oriented language; Java skills are highly desirable.
• Deep understanding in designing, implementing data lifecycle management.
• Deep understanding of Event driven architecture, data producers and consumers.
• Knowledge on data analytics pipeline, data lakehouse & warehouse concept. Curate data for exporting to data analytics tools for data processing pipeline to provide business analytics outcomes.
• Experience with relational and non-relational databasesFamiliar with Product Development and Design thinking approach
• Excellent communication, collaboration, and problem-solving skills
• Ability to work independently and as part of a team.
• 5 day week @ AMK area