Azure Data Engineer

NSD International, Inc.; Charlotte (NC); Hybrid; USD 84,000 - 120,000; Full time

Benefits offered by this job

401(k) matching

Dental insurance

Health insurance

Vision insurance

Job summary

NSD International, Inc. is hiring an Azure Data Engineer for contract work to support an Azure-based data platform. You will collaborate with the team to develop and refine data capabilities.

The initial focus is establishing a reference data system for securities and pricing, then expanding to additional domains, governance, and data quality tooling. Proficiency in Python, PySpark, SQL, and Azure services is required; hybrid work in Charlotte, NC.

Qualifications

• 10+ years of software development experience using Python and PySpark.
• Proven Data Engineer/Data Quality Engineer with Azure cloud experience.
• Hands-on with Azure Data Factory, Lake Gen 2, Databases and Databricks.
• Experience with Collibra Data Quality/Governance and data lineage tools.

Responsibilities

• Support the active development of an Azure data platform in close coordination with the team.
• Begin with establishing a reference data system for securities and pricing data, then expand to additional data domains.
• Follow internal development standards to contribute to the Data Strategy agenda.
• Implement Azure Cloud Platform solutions across the listed qualifications.

Tools

Python

PySpark

Azure cloud services

Azure Data Factory

Azure Lake Gen 2

Azure Databases

Azure Databricks

Power BI

SQL

RDMs

noSQL

git

Jenkins

CI/CD processes

ETL/ELT

Data Quality

Collibra Data Quality

IDQ

IBM

Ab-Initio

Collibra Data Governance

data lineage

Job description

NSD International, Inc. is hiring an Azure Data Engineer for contract work supporting an Azure-based data platform.

Responsibilities

• Support the active development of an Azure data platform in close coordination with the team
• Begin with establishing a reference data system for securities and pricing data, then expand to additional data domains
• Follow internal development standards to contribute to the overall Data Strategy agenda
• Implement Azure Cloud Platform solutions and apply relevant know-how across the qualifications listed below

Requirements

• 10+ years of software development experience using Python and PySpark and associated frameworks
• Proven background as a Data Engineer and/or Data Quality Engineer with Azure cloud experience
• Experience implementing solutions with Azure cloud services
• Hands-on experience implementing Azure Data Factory
• Hands-on experience implementing Azure Lake Gen 2
• Hands-on experience implementing Azure Databases
• Hands-on experience implementing Azure Databricks
• Experience implementing a Data Quality Framework/Solution
• Experience implementing Collibra Data Quality or other data quality tools including IDQ, IBM, or Ab-Initio
• Experience implementing Collibra Data Governance with knowledge of data lineage
• Experience implementing Power BI
• Well versed with Azure Databricks
• Strong SQL skills with RDMs or noSQL databases
• Familiarity with the DevOps lifecycle including git and Jenkins
• Experience with CI/CD processes
• Good understanding of ETL/ELT processes
• Financial services industry experience is a plus, including financial instruments, asset classes, and market data

Key Technologies

• Python, PySpark
• Azure cloud services
• Azure Data Factory
• Azure Lake Gen 2
• Azure Databases
• Azure Databricks
• Data Quality Framework/Solution
• Collibra Data Quality, IDQ, IBM, Ab-Initio
• Collibra Data Governance, data lineage
• Power BI
• SQL, RDMs, noSQL
• DevOps lifecycle: git, Jenkins, CI/CD processes
• ETL, ELT

Benefits

• 401(k) matching
• Dental insurance
• Health insurance
• Vision insurance

Contract Details

• Job type: contract
• Term: 1 year (possibility of extension)
• Pay: $74.00 per hour
• Expected hours: 35.0 – 45.0 per week
• Work location: Hybrid remote in Charlotte, NC 28202