Senior Data Engineer: Metadata Governance & Cataloging

Insight Global; Newark (NJ); On-site; USD 140,000 - 190,000; Full time

Job summary

Insight Global is seeking a senior-level Data Engineer consultant to lead metadata scanning, cataloging, lineage, governance, and Data Product implementation across a complex enterprise data ecosystem. The role spans relational, NoSQL, API, and event-driven sources, requiring expert Informatica CDGC, profiling, and strong scripting skills.

Candidates should have experience with MongoDB, AWS DocumentDB, Kafka, Kinesis/SQS, and multiple databases (Oracle, SQL Server, PostgreSQL).

Qualifications

• Expert-level Informatica CDGC expertise with hands-on Data Products experience.
• Proven profiling experience and metadata governance skills.
• Experience ingesting metadata for MongoDB and AWS DocumentDB when connectors are unavailable.
• Strong Python or Java scripting skills.
• Experience with Oracle, SQL Server, PostgreSQL; AWS services including S3, Kinesis.

Responsibilities

• Lead metadata scanning, cataloging, lineage, and governance across a complex enterprise data ecosystem.
• Implement Data Product solutions and lineage for relational, NoSQL, API, and event-driven sources.
• Collaborate on governance glossary management, classification, and stewardship.

Skills

Informatica CDGC

Data governance

Metadata ingestion

Python

Java

REST APIs governance

Tools

MongoDB

AWS DocumentDB

Kafka

AWS Kinesis/SQS

Oracle

SQL Server

PostgreSQL

AWS S3

Power BI

Microsoft Fabric

Informatica CDIDenodo/Atacama

Job description

Insight Global is seeking a senior-level Data Engineer consultant to lead metadata scanning, cataloging, lineage, governance, and Data Product implementation across a complex enterprise data ecosystem. The role spans relational, NoSQL, API, and event-driven sources, requiring expert Informatica CDGC, profiling, and strong scripting skills.

Candidates should have experience with MongoDB, AWS DocumentDB, Kafka, Kinesis/SQS, and multiple databases (Oracle, SQL Server, PostgreSQL).