Senior Data Engineer

Compunnel, Inc.; Newark (NJ); On-site; USD 140,000 - 170,000; Full time

Job summary

Compunnel, Inc. is seeking a Senior Data Engineer to support a strategic enterprise data transformation initiative focused on centralizing and productizing market data assets.

The role involves building a new enterprise data repository and data delivery platform within an enterprise data management program, with hands-on design of data pipelines and integration of market data sources. You will work on creating scalable ingestion, validation, and data quality processes, leveraging Microsoft

Qualifications

• Experience building data pipelines from the ground up.
• Hands-on with Microsoft Fabric and Medallion Architecture.
• Strong SQL skills and ability to integrate data from multiple sources.
• Experience with Enterprise Data Management platforms (GoldenSource, Rimes, Bloomberg EDM, Gresham).

Responsibilities

• Design, build, and maintain scalable data pipelines from EDM platforms into Microsoft Fabric.
• Build ingesting frameworks for third-party market data feeds.
• Support direct ingestion of data sources into Fabric when EDM is not used.
• Develop and maintain data validation, reconciliation, and quality rules.
• Create and manage data extracts from EDM platforms.
• Build and maintain enterprise data layers aligned with Medallion Architecture.
• Integrate, transform, cleanse, and consolidate data from multiple source systems.
• Develop interfaces and mechanisms for data flow, accessibility, and consumption.
• Collaborate with business analysts, data governance teams, and technical stakeholders throughout the implementation lifecycle.

Skills

Data pipelines design

Market data integration

Microsoft Fabric experience

Medallion Architecture (Bronze/Silver/

SQL skills

Data validation/quality

ETL/ELT ingestion

EDM platforms integration

Tools

GoldenSource

Rimes

Bloomberg EDM

Gresham EDM

Job description

JOB SUMMARY

JOB SUMMARY The Senior Data Engineer will support a strategic enterprise data transformation initiative focused on centralizing and productizing market data assets. This role will be instrumental in building a new enterprise data repository and data delivery platform as part of a broader domain activation and enterprise data management program. This is a hands-on Data Engineering position focused on designing and developing new data pipelines, integrating market data sources, and enabling an enterprise-grade Microsoft Fabric environment.

Key Responsibilities

• Design, build, and maintain scalable data pipelines from EDM platforms into Microsoft Fabric
• Build ingesting frameworks for third-party market data feeds
• Support direct ingestion of certain data sources into Fabric when EDM is not utilized
• Develop and maintain data validation, reconciliation, and quality rules
• Create and manage data extracts from EDM platforms
• Build and maintain enterprise data layers aligned with Medallion Architecture principles
• Integrate, transform, cleanse, and consolidate data from multiple source systems
• Develop interfaces and mechanisms for data flow, accessibility, and consumption
• Collaborate closely with business analysts, data governance teams, and technical stakeholders throughout the implementation lifecycle

Required Qualifications

• Strong Data Engineering experience building data pipelines from the ground up
• Experience working with Market Data feeds within: Asset Management, Investment Management, Banking, Financial Services
• Hands-on experience with Microsoft Fabric
• Experience designing and implementing Medallion Architecture (Bronze, Silver, Gold layers)
• Strong SQL skills
• Experience integrating data from multiple source systems and preparing data for analytical and operational use
• Experience developing scalable ingestion, transformation, and validation processes
• Experience working with Enterprise Data Management platforms such as: GoldenSource, Rimes, Bloomberg EDM, Gresham, or other comparable EDM/vendor-based data management solutions

Preferred Qualifications

• Microsoft Purview experience
• Experience with data governance and data quality frameworks
• Metadata management experience
• Experience supporting enterprise data repositories and data product initiatives