Cloud Engineer

JALANDHAR SC PTE. LTD.; Singapore; On-site; SGD 140,000 - 210,000; Full time

Job summary

JALANDHAR SC PTE. LTD. in Singapore is seeking a senior Cloud/Data Engineer to lead data storage, processing, and governance initiatives.

You will optimize cloud data stores and warehouses, design Delta Lake environments, and implement metadata and data-quality solutions using IDMC, AWS, and Databricks. The role requires 6+ years in cloud/data engineering, strong AWS/Databricks/IDMC experience, and a degree in CS/IT/Engineering.

Qualifications

• Bachelor's degree in CS/IT/Engineering or related field.
• 6+ years of professional experience in cloud/data engineering.
• Strong hands-on experience with AWS, Databricks, and Informatica IDMC.
• Ability to work independently as well as collaboratively in a cross-functional environment.

Responsibilities

• Manage and optimize cloud-based data storage (S3, RDS, Redshift, DynamoDB) and data warehouses.
• Design and optimize Databricks Delta Lake environments and data processing.
• Implement IDMC for metadata management, data cataloging, integration, quality, and governance.
• Develop and optimize data pipelines using AWS Glue, Data Pipeline, Lambda, Databricks, and IDMC.
• Integrate data from multiple sources into AWS and Databricks environments with quality and reliability.
• Design and manage ETL/ELT processes to prep data for analytics.
• Leverage Databricks Spark for large-scale data processing.

Skills

AWS

Databricks

Informatica IDMC

Delta Lake

ETL/ELT

Data pipelines

Spark

Education

Bachelor's degree in Computer Science, Information Technology, Engineering, Data Engineering

Tools

AWS Glue

AWS Data Pipeline

AWS Lambda

Databricks

Informatica IDMC

Job description

Key Responsibilities

• Manage and optimize cloud-based data storage solutions includingAmazon S3, Amazon RDS, Amazon Redshift, Amazon DynamoDB, databases, data lakes, and data warehouses.
• Design, manage, and optimizeDatabricks Delta Lakeenvironments and data processing solutions.
• Implement and manageInformatica Intelligent Data Management Cloud (IDMC)for metadata management, data cataloging, integration, data quality, and governance.
• Develop, maintain, and optimize data pipelines for data ingestion, processing, transformation, and movement usingAWS Glue, AWS Data Pipeline, AWS Lambda, Databricks, and Informatica IDMC.
• Integrate data from multiple internal and external sources intoAWS and Databricksenvironments while ensuring data consistency, accuracy, quality, and reliability.
• Design and manageETL/ELT processesto cleanse, transform, enrich, and prepare data for analytics and reporting.
• LeverageDatabricks Apache Sparkcapabilities for large-scale data processing and transformation.

Qualifications

• Bachelor's degree inComputer Science, Information Technology, Engineering, Data Engineering, or a related discipline.
• 6+ years of professional experiencein Cloud Engineering, Data Engineering, or Cloud Data Platforms.
• Strong hands-on experience withAWS, Databricks, and Informatica IDMC.
• Strong analytical, troubleshooting, and problem-solving skills.
• Ability to work independently as well as collaboratively in a cross-functional environment.