Data Engineer

HELIUS TECHNOLOGIES PTE. LTD.; Singapore; On-site; SGD 80,000 - 120,000; Full time

Job summary

A premier technology firm in Singapore is seeking a skilled Cloud Data Engineer to build and maintain a robust data infrastructure. The ideal candidate will have over 6 years of experience in data engineering, with a deep expertise in AWS services, Databricks, and Informatica IDMC. Responsibilities include creating and optimizing data pipelines and integrating data sources to ensure data consistency and quality. This role offers an exciting opportunity to work in a dynamic environment focusing on data analytics and management.

Qualifications

• Minimum 6+ years of experience in data engineering.
• Expertise in AWS services, Databricks, and Informatica IDMC.
• Strong knowledge of programming languages such as Python, Java, or Scala.

Responsibilities

• Create, manage, and optimize data pipelines using AWS services.
• Integrate data from various sources into AWS and Databricks environments.

Skills

AWS services

Databricks

Informatica IDMC

Python

Java

Scala

SQL

NoSQL databases

Education

Bachelor’s or master’s degree in computer science, data engineering, or a related field

Job description

A Cloud Data Engineer specializing in AWS, Databricks, and Informatica IDMC is responsible for building and maintaining a robust, integrated, and governed data infrastructure that leverages the strengths of the analytics platforms to extract valuable insights from data while ensuring data security, compliance, and high-quality data management.

Job Requirement

• Bachelor’s or master’s degree in computer science, data engineering, or a related field.
• Minimum 6+ years of experience in data engineering, with expertise in AWS services, Databricks, and/or Informatica IDMC.
• Proficiency in programming languages such as Python, Java, or Scala for building data pipelines.
• Evaluate potential technical solutions and make recommendations to resolve data issues especially on performance assessment for complex data transformations and long running data processes.
• Strong knowledge of SQL and NoSQL databases.
• Familiarity with data modeling and schema design.

Responsibilities

• Create, manage, and optimize data pipelines for ingesting, processing, and transforming data using AWS services like AWS Glue, AWS Data Pipeline, and AWS Lambda, Databricks for advanced data processing, and Informatica IDMC for data integration and quality.
• Integrate data from various sources, both internal and external, into AWS and Databricks environments, ensuring data consistency and quality, while leveraging Informatica IDMC for data integration, transformation, and governance.

Thanks, and Best Regards

Karanam Vijaya Kiran

(EA Registration no: R1443178)

HP: [phone]

Recruitment Manager

Helius Technologies Pte Ltd (EA No: 11C3373)

https://www.linkedin.com/in/vijay-karanam-68462131/