Data Engineer

RSC Solutions; Charlotte (NC); Hybrid; USD 110,000 - 150,000; Full time

Job summary

RSC Solutions seeks a data engineering professional to help build and evolve a reference data platform for securities and pricing data. The role requires strong Python and PySpark skills and hands-on Azure cloud experience.

You will work with Client's Americas Division teams to implement scalable data pipelines, APIs, and cloud-native components, ensuring alignment with internal standards and security practices.

Qualifications

• Full stack Python/PySpark developer with data engineering focus.
• Experience implementing data platforms on Azure cloud.
• Familiarity with ETL/ELT processes and data pipelines.

Responsibilities

• Develop and extend the data platform for securities and pricing data.
• Collaborate with Client's teams to align with Data Strategy.
• Implement Azure-based solutions and maintain CI/CD workflows.

Skills

Python

PySpark

SQL

APIs

Tools

Azure Cloud

Azure Data Factory

Azure Lake Gen 2

Azure Databases

Azure Data Fabric

API Gateway management

Azure Functions

Azure Databricks

Job description

Hybrid role

Role Objectives

• These roles will be part of the Data Strategy team spanning across the Client's Capital Markets and Nikko securities teams, Client's Americas Division's broker-dealer and swap-dealer entities.
• These roles will be involved in the active development of the data platform in close coordination with the Client's team, beginning with the establishment of a reference data system for securities and pricing data, and later moving to other data domains.
• The consulting team will need to follow internal developments standards to contribute to the overall agenda of the Data Strategy team.
• The implementation of this strategic platform on Client's Azure Cloud Platform will require solutions and know-how as listed in the qualifications below.

Qualifications and Skills

• Full stack Python/PySpark developer
• Proven experience as a Data Engineer with experience in Azure cloud.
• Experience implementing solutions using -
• Azure cloud services
• Azure Data Factory
• Azure Lake Gen 2
• Azure Databases
• Azure Data Fabric
• API Gateway management
• Azure Functions
• Well versed with Azure Databricks
• Strong SQL skills with RDMS or noSQL databases
• Experience with developing API's using FastAPI or similar frameworks in Python
• Familiarity with the DevOps lifecycle (git, Jenkins, etc.), CI/CD processes
• Good understanding of ETL/ELT processes
• Experience in financial services industry, financial instruments, asset classes and market data are a plus.