Senior Data Engineer: Enterprise Data Platform & Fabric

Compunnel, Inc.; Newark (NJ); On-site; USD 140,000 - 170,000; Full time

Job summary

Compunnel, Inc. is seeking a Senior Data Engineer to support a strategic enterprise data transformation initiative focused on centralizing and productizing market data assets.

The role involves building a new enterprise data repository and data delivery platform within an enterprise data management program, with hands-on design of data pipelines and integration of market data sources. You will work on creating scalable ingestion, validation, and data quality processes, leveraging Microsoft

Qualifications

• Experience building data pipelines from the ground up.
• Hands-on with Microsoft Fabric and Medallion Architecture.
• Strong SQL skills and ability to integrate data from multiple sources.
• Experience with Enterprise Data Management platforms (GoldenSource, Rimes, Bloomberg EDM, Gresham).

Responsibilities

• Design, build, and maintain scalable data pipelines from EDM platforms into Microsoft Fabric.
• Build ingesting frameworks for third-party market data feeds.
• Support direct ingestion of data sources into Fabric when EDM is not used.
• Develop and maintain data validation, reconciliation, and quality rules.
• Create and manage data extracts from EDM platforms.
• Build and maintain enterprise data layers aligned with Medallion Architecture.
• Integrate, transform, cleanse, and consolidate data from multiple source systems.
• Develop interfaces and mechanisms for data flow, accessibility, and consumption.
• Collaborate with business analysts, data governance teams, and technical stakeholders throughout the implementation lifecycle.

Skills

Data pipelines design

Market data integration

Microsoft Fabric experience

Medallion Architecture (Bronze/Silver/

SQL skills

Data validation/quality

ETL/ELT ingestion

EDM platforms integration

Tools

GoldenSource

Rimes

Bloomberg EDM

Gresham EDM

Job description

Compunnel, Inc. is seeking a Senior Data Engineer to support a strategic enterprise data transformation initiative focused on centralizing and productizing market data assets.

The role involves building a new enterprise data repository and data delivery platform within an enterprise data management program, with hands-on design of data pipelines and integration of market data sources. You will work on creating scalable ingestion, validation, and data quality processes, leveraging Microsoft