Manager - Data & Cloud Engineer (DNA)

Synapxe

Singapore

On-site

SGD 90,000 - 120,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Synapxe is seeking a data integration specialist to lead the migration from Informatica PowerCenter to Informatica IDMC. The role involves hands-on IDMC work, creating mappings and workflows, and setting up Secure Agents.

You will integrate data from diverse sources into AWS and Databricks, ensure data quality, and apply governance and security best practices. Collaboration with data scientists and engineers is essential.

Responsibilities

  • Migrate from Informatica PowerCenter to IDMC with minimal business disruption.
  • Hands-on work in IDMC: create mappings, workflows, and Secure Agent setup.
  • Integrate data from diverse sources into AWS and Databricks, ensuring quality.
  • Use IDMC for data integration, transformation and governance.
  • Develop ETL processes to cleanse and enrich data for analytics using Databricks Spark and IDMC.
  • Monitor and optimize data processing and queries in AWS and Databricks.
  • Apply security best practices and data encryption; ensure privacy compliance.
  • Document data infrastructure, pipelines, configurations, and metadata in AWS/Databricks with IDMC.
  • Collaborate with data scientists, analysts and engineers to meet data requirements across AWS, Databricks and IDMC.
  • Identify data issues and support data availability and integrity; optimize resource usage to control costs.

Job description

  • Manage the end-to-end migration process from informatica PowerCenter (CDI PC) to Informatica IDMC, ensuring minimal disruption to business operations.
  • Hands on experience in Informatica IDMC for creating mappings, workflows, setting up Secure Agents etc.,
  • Integrate data from various sources, both internal and external, into AWS and Databricks environments, ensuring data consistency and quality, while leveraging
  • Informatica IDMC for data integration, transformation, and governance.
  • Develop ETL (Extract, Transform, Load) processes to cleanse, transform, and enrich data, making it suitable for analytical purposes using Databricks' Spark capabilities and Informatica IDMC for data transformation and quality.
  • Monitor and optimize data processing and query performance in both AWS and Databricks environments, making necessary adjustments to meet performance and scalability requirements. Utilize Informatica IDMC for optimizing data workflows.
  • Implement security best practices and data encryption methods to protect sensitive data in both AWS and Databricks, while ensuring compliance with data privacy regulations. Employ Informatica IDMC for data governance and compliance.
  • Maintain clear and comprehensive documentation of data infrastructure, pipelines, and configurations in both AWS and Databricks environments, with metadata management facilitated by Informatica IDMC.
  • Collaborate with cross-functional teams, including data scientists, analysts, and software engineers, to understand data requirements and deliver appropriate solutions across AWS, Databricks, and Informatica IDMC.
  • Identify and resolve data-related issues and provide support to ensure data availability and integrity in both AWS, Databricks, and Informatica IDMC environments.
    Optimize AWS, Databricks, and Informatica resource usage to control costs while meeting performance and scalability requirements.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Assistant Lead Analyst - Informatica (Engineering)
Assistant Lead Analyst - Informatica (Engineering)

Synapxe • Singapore

On-site
SGD 120,000 - 160,000
Data & Cloud Engineering Lead - IDMC, AWS & Databricks
Data & Cloud Engineering Lead - IDMC, AWS & Databricks

Synapxe • Singapore

On-site
SGD 90,000 - 120,000
Senior Cloud Data Engineer - AWS, Databricks & IDMC
Senior Cloud Data Engineer - AWS, Databricks & IDMC

Tech Junction Ltd • Singapore

On-site
SGD 90,000 - 150,000
Data Engineer
Data Engineer

DIGITAL BIZ SOLUTIONS PTE. LTD. • Singapore

On-site
SGD 120,000 - 180,000
Informatica Developer
Informatica Developer

DBiz.ai • Singapore

On-site
SGD 120,000 - 170,000
Lead Data Engineer – Informatica, AWS & Databricks
Lead Data Engineer – Informatica, AWS & Databricks

Synapxe • Singapore

Hybrid
SGD 120,000 - 160,000
Data Engineer (1-Year Contract – Renewable / Convertible)
Data Engineer (1-Year Contract – Renewable / Convertible)

ST Engineering Urban Solutions • Singapore

On-site
SGD 90,000 - 130,000
Senior Manager
Senior Manager

National Healthcare Group Corporate Office (HQ) • Singapore

On-site
SGD 120,000 - 180,000
Data Engineer
Data Engineer

Epergne Solutions • Singapore

On-site
SGD 120,000 - 180,000
Data Engineer (AWS, Databricks & Informatica IDMC) | Path Infotech | Singapore
Data Engineer (AWS, Databricks & Informatica IDMC) | Path Infotech | Singapore

Tech Junction Ltd • Singapore

On-site
SGD 90,000 - 150,000