Data Engineer

Maestro Human Resource Pte Ltd; Singapore; On-site; SGD 60,000 - 80,000; Full time

Job summary

A leading human resources firm in Singapore is seeking a Data Engineer to join its product development team. You will design and implement data integration pipelines and work closely with software engineers to enhance product quality. Ideal candidates have a Bachelor's/Master's in a relevant field and skills in SQL and Java. This role emphasizes strong data manipulation skills and experience in event-driven architectures, attractive for those passionate about data management and analytics.

Qualifications

• Bachelor's/Master's degree in a relevant field, or Diploma holders with experience.
• Proficiency in at least one object-oriented language, Java skills are highly desirable.
• Deep understanding of event driven architecture and data lifecycle management.

Responsibilities

• Design and implementation of data integration pipelines.
• Collaborate with Software Engineers in product enhancements.
• Maintain scalable data models and schemas.

Skills

SQL

Java

Event driven architecture

Data integration

Data transformation

Education

Bachelor's/Master's degree in Computer Science/Engineering

Tools

Apache Kafka

Solace Pubsub

IoT devices

Job description

We are looking for aspiring Data Engineer to join our product development team, you will be responsible for the design and implementation of data integration pipeline and asynchronous data event using event driven architecture approach to consolidate data from various sources and systems.

About the Role

• Collaborating with a team of highly skilled Software Engineers and Data Engineers in deploying and delivering software products.Actively participating in product enhancement, particularly in the areas of integration and UI, to improve product quality and reconfigurability.

• Taking ownership of the development of key software components.

• Design, develop and maintain scalable data models and schemas using various data modelling best practices.

• Design and develop integration connectors to facilitate data integration from multiple sources and systems, including databases, APIs, log files, streaming platforms, IoT end devices and external data providers.

• Data Transformation and Processing: Develop data transformation routines to clean, normalize, and aggregate data. Apply data processing techniques to handle complex data structures, handle missing or inconsistent data, and prepare the data for analysis or reporting.

• Strong knowledge of data manipulation languages such as SQL necessary to build and maintain complex queries and data pipelines.

• Implement event-driven processing pipelines using frameworks like Solace Pubsub, Apache Kafka, MQTT, AMQP.

• Ensure compliance to data governance policies and standards to ensure data quality, integrity, security and consistency.

• Experience working in a dynamic environment with managing senior stakeholders from different organisations and agencies.

Requirements

• Bachelor's/Master's degree specializing in Computer Science / Engineering / Industrial Engineering or related field. Diploma holders with relevant experience are encouraged to apply.

• Proficiency in at least one object-oriented language; Java skills are highly desirable.

• Deep understanding in designing, implementing data lifecycle management.

• Deep understanding of Event driven architecture, data producers and consumers.

• Knowledge on data analytics pipeline, data lakehouse & warehouse concept. Curate data for exporting to data analytics tools for data processing pipeline to provide business analytics outcomes

• Working location: AMK area

• Singaporeans

Maestro HR

damien lee tian hong

R1106726

16C8462