Senior Data Engineer: Azure & Dataverse, Big Data (Contract)

hackajob; New York (NY); On-site; USD 100,000 - 140,000; Part time

Job summary

A leading tech recruitment agency is seeking an experienced Data Engineer to join their team in New York City. This role involves designing and optimizing data solutions that support crucial business processes. The ideal candidate should have at least 5 years of experience in data engineering, particularly with Azure cloud services and a strong knowledge of SQL and Python. The company offers a contract position in a dynamic and collaborative environment.

Qualifications

• 5+ years of experience in data engineering and database optimization.
• Strong hands-on experience with Azure cloud data services.
• Deep understanding of Dataverse and Microsoft Dynamics 365 data architecture.
• Proficiency in SQL and Python for data manipulation and pipeline development.
• Familiarity with data governance, security, and compliance in cloud environments.

Responsibilities

• Manage and maintain multi-terabyte datasets on Dataverse.
• Design and implement scalable data models focused on optimization.
• Perform data archival processes and support reconciliation of datasets.
• Develop and maintain data warehousing solutions.
• Build and maintain ETL pipelines using Azure cloud data services.

Skills

Data engineering

Database optimization

SQL

Python

Azure cloud data services

Tools

Microsoft Fabric

Snowflake

Power BI

Azure SQL

Azure Cosmos DB

Job description

A leading tech recruitment agency is seeking an experienced Data Engineer to join their team in New York City. This role involves designing and optimizing data solutions that support crucial business processes. The ideal candidate should have at least 5 years of experience in data engineering, particularly with Azure cloud services and a strong knowledge of SQL and Python. The company offers a contract position in a dynamic and collaborative environment.