Data Engineer

Creative Solutions Services, LLC; Newark (NJ); Hybrid; USD 90,000 - 103,000; Part time

Job summary

Creative Solutions Services, LLC is seeking a Data Engineer for a long-term contract position. The role is hybrid with three days per week in Newark, NJ, focusing on centralizing market data feeds and integrating EDM systems into MS Fabric.

You will ensure data quality across datasets and prepare data for analytical and operational use. Your responsibilities include designing medallion architecture, building scalable pipelines from EDM vendors into MS Fabric, migrating ingestion processes, and

Qualifications

• 5-10 years of experience in data engineering or related field.
• Experience with financial market data and data governance is preferred.
• Hands-on experience with EDM systems and data quality rules.

Responsibilities

• Centralize market data feeds from multiple vendors into a Market Data Hub.
• Design, build and maintain scalable data pipelines from EDM vendors into MS Fabric.
• Migrate existing ingestion and ETF processes to MS Fabric/EDM System and sunset legacy feeds.
• Design and implement data quality checks and data validation across datasets.
• Note: some feeds may bypass EDM and ingest directly into MS Fabric.

Skills

Market data feeds

Data engineering

Big data pipelines

Stakeholder communication

Tools

MS Fabric

Gresham

GoldenSource

RIMES

Bloomberg

Microsoft Purview

Job description

Long term Contract position with a major financial firm. Hybrid, 3 days/week in Newark, NJ.

Data Engineer:

Business Requirements:

• Centralize market data feeds from various third-party market data vendors into the central "Market Data Hub.
• Source data feeds from a 3rd party EDM system (e.g. Gresham, Golden Source, RIMES, Bloomberg).
• Ensure that data quality rules and checks are applied to each dataset. (This would be configurable within the EDM System)
• Land consolidated data from EDM system withinMS Fabric (example data flow: 3rd party market data vendor EDM System MS Fabric)
• Migrate existing market data feed ingestion and ETF processes to the MS Fabric or EDM System.
• Sunset existing market data feed ingestion.

5-10 years of experience.

Responsibilities:

• Prior experience working with Market Data feeds and asset management industry or financial services experience.
• Prior experience designing and implementing a medallion architecture for enterprise data.
• Prior experience in Fabric and EDM (e.g. enterprise data management system, like Gresham, Golden Source, RIMES, Bloomberg) preferred.
• Design, build and maintain data quality rules and data extracts from EDM vendor.
• Design, build and maintain scalable data pipelines from EDM vendor into MS Fabric to support 3rd party market data feeds.
• Note some data feeds may need to bypass the EDM vendor and be ingested directly into MS Fabric.
• Design, build and maintain data validation and quality rules for data ingested into MS fabric.
• Prior experience with Microsoft Purview or other data governance tool is a plus
• Prepares data for analytical or operational uses
• Builds data pipelines to pull information from different source systems; integrating, consolidating and cleansing data; and structuring it for use in applications
• Creates interfaces and mechanisms for the flow and access of information.

payrate 65 - 75per hour depending on experience

#LI-AC1