Data Engineer – Azure Big Data & Snowflake

VirtueTech inc; India; On-site; INR 600,000 - 1,000,000; Full time

Job summary

VirtueTech inc is looking for a Data Engineer specializing in the Azure ecosystem. This role entails designing and optimizing data pipelines along with implementing scalable architectures essential for effective analytics and reporting.

The ideal candidate will have extensive experience with Spark and Snowflake, and must excel in writing complex SQL queries. Collaboration with cross-functional teams and adherence to data governance practices are also key components of the position.

Qualifications

• Strong experience in Azure ecosystem with Big Data technologies.
• Proficient in designing and developing data pipelines.
• Experience with data modeling techniques for analytics.

Responsibilities

• Design and maintain Azure-based data solutions.
• Build scalable ETL pipelines using Azure Data Factory.
• Write and optimize complex SQL queries in Snowflake.
• Implement data security and governance best practices.

Skills

Azure Big Data services

Spark

Snowflake

SQL

ETL pipelines

Job description

Overview

A Data Engineer specializing in the Azure ecosystem, with strong experience in Spark, Big Data technologies, and Snowflake data modeling. The role involves designing, developing, and optimizing data pipelines, implementing scalable architectures, and ensuring efficient data solutions for analytics and reporting.

Responsibilities

• Design, develop, and maintain Azure-based data solutions with Spark and Snowflake.
• Build and optimize scalable ETL pipelines using Azure Data Factory, Databricks, and Snowflake.
• Write, optimize, and troubleshoot complex SQL queries in Snowflake.
• Implement data modeling techniques such as Data Cubes for analytical reporting.
• Collaborate with data scientists, business analysts, and cross-functional teams.
• Ensure data security, compliance, and governance best practices.
• Monitor and optimize performance of Big Data processing workflows.

Technical Skills

• Expertise in Azure Big Data services (Azure Synapse, Azure Data Lake, Databricks).
• Proficient in Spark, Snowflake, and data modeling techniques.
• Experience with building scalable ETL pipelines using Azure Data Factory.
• Strong SQL skills for querying, tuning, and managing large datasets.
• Knowledge of data warehousing concepts, including Data Cubes and star schema.
• Familiarity with DevOps practices and CI/CD pipelines in Azure.

Soft Skills

• Excellent problem-solving and communication skills.
• Ability to work in fast-paced environments and deliver under tight deadlines.
• Collaborative mindset with a focus on business impact.
• Strong analytical thinking with attention to detail.