Senior Data Engineer

hackajob; New York (NY); On-site; USD 100,000 - 140,000; Part time

Job summary

A leading tech recruitment agency is seeking an experienced Data Engineer to join their team in New York City. This role involves designing and optimizing data solutions that support crucial business processes. The ideal candidate should have at least 5 years of experience in data engineering, particularly with Azure cloud services and a strong knowledge of SQL and Python. The company offers a contract position in a dynamic and collaborative environment.

Qualifications

• 5+ years of experience in data engineering and database optimization.
• Strong hands-on experience with Azure cloud data services.
• Deep understanding of Dataverse and Microsoft Dynamics 365 data architecture.
• Proficiency in SQL and Python for data manipulation and pipeline development.
• Familiarity with data governance, security, and compliance in cloud environments.

Responsibilities

• Manage and maintain multi-terabyte datasets on Dataverse.
• Design and implement scalable data models focused on optimization.
• Perform data archival processes and support reconciliation of datasets.
• Develop and maintain data warehousing solutions.
• Build and maintain ETL pipelines using Azure cloud data services.

Skills

Data engineering

Database optimization

SQL

Python

Azure cloud data services

Tools

Microsoft Fabric

Snowflake

Power BI

Azure SQL

Azure Cosmos DB

Job description

hackajob on-demand focuses on matching talented contractors like you with organisations seeking specific skills for their projects. We use our platform to connect you with exciting contract opportunities and discuss projects on behalf of the companies we partner with.

We are looking for an experienced Data Engineer to join our team and help design, build, and optimize data solutions that power critical business processes. The ideal candidate will bring strong expertise in Azure data services, Dataverse, and large-scale data architecture. This role is perfect for someone who thrives in handling complex data challenges and collaborating with cross-functional teams to deliver scalable, high-performance solutions.

Responsibilities:

• Manage and maintain multi-terabyte datasets on Dataverse, utilizing platforms like Azure SQL and Azure Cosmos DB.
• Design and implement scalable data models (both relational and non-relational) with a focus on optimization and performance tuning.
• Perform data archival processes and support reconciliation of large datasets.
• Develop and maintain data warehousing solutions, ideally with experience in tools such as Microsoft Fabric or Snowflake.
• Build and maintain ETL pipelines using Azure cloud data services.
• Collaborate with cross-functional teams including developers, architects, and business analysts to deliver scalable data solutions.

Requirements

• 5+ years of experience in data engineering and database optimization.
• Strong hands-on experience with Azure cloud data services.
• Deep understanding of Dataverse and Microsoft Dynamics 365 data architecture.
• Proficiency in SQL and Python for data manipulation and pipeline development.
• Familiarity with data governance, security, and compliance in cloud environments.
• Excellent problem-solving and communication skills.

Nice to have

• Experience with Microsoft Fabric or Snowflake.
• Exposure to Power Platform, especially Power Apps and Power Automate.
• Knowledge of data visualization tools like Power BI.

Job Details

• Seniority level: Mid-Senior level
• Employment type: Contract
• Job function: Consulting
• Industries: Banking

Referrals increase your chances of interviewing at hackajob by 2x