DATA ENGINEER (AZURE)

Vrinda International; India; Presencial; INR 2.160.000 - 2.640.000; Jornada completa

Descripción de la vacante

Vrinda International is seeking a skilled Data Engineer to design, build, and maintain robust data infrastructure in the IT Services sector. You will architect scalable data solutions on Microsoft Azure, ensuring data flow, integrity and accessibility for analytics and decision making.

You will develop ETL pipelines with ADF and PySpark, model data using Azure Synapse, and collaborate with cross-functional teams to deliver data-driven insights that support strategic business goals.

Formación

• 4–9 years of professional data engineering experience.
• Deep knowledge of Azure data services (ADLS, Synapse).
• Experience with Delta Lake architecture and data warehousing.
• Proficient in ETL with Azure Data Factory and PySpark.
• Strong Python and SQL scripting for data processing.
• Experience in Databricks environments.
• Compensation around ₹24 LPA based on experience.

Responsabilidades

• Design and implement scalable data storage and processing architectures using ADLS and Delta Lake.
• Develop and optimize ETL pipelines with ADF and PySpark.
• Build data models and warehouses using Azure Synapse Analytics.
• Construct and maintain data pipelines integrating diverse data sources.
• Write Python and SQL scripts to automate data processes and quality checks.
• Collaborate with cross-functional teams to define data requirements.

Conocimientos

Azure

ADLS

Delta Lake

Azure Data Factory

PySpark

Python

SQL

Databricks

Synapse Analytics

Data Warehousing

Herramientas

Databricks

Azure Synapse

Azure Data Lake Storage

Delta Lake

Descripción del empleo

Job Description

Summary

We are seeking a skilled Data Engineer to design, build, and maintain robust data infrastructure within the IT Services sector. This pivotal role focuses on architecting scalable data solutions using Microsoft Azure technologies to ensure seamless data flow, integrity, and accessibility. The successful candidate will play a critical part in transforming raw data into actionable insights, supporting strategic business decisions through advanced data warehousing and analytics capabilities.

Responsibilities

• Design and implement scalable data storage and processing architectures utilizing Azure Data Lake Storage (ADLS) and Delta Lake.
  
• Develop and optimize complex ETL pipelines using Azure Data Factory (ADF) and PySpark to ensure efficient data movement and transformation.
  
• Build and manage data models and warehouses, leveraging Azure Synapse Analytics for high-performance querying and reporting.
  
• Construct and maintain data pipelines that integrate diverse data sources, ensuring accuracy and consistency across the ecosystem.
  
• Write and refine Python and SQL scripts to automate data processes, perform data quality checks, and support analytical workflows.
  
• Collaborate with cross-functional teams to define data requirements and deliver solutions that align with organizational goals.
  

Requirements

Requirements:

• Possess 4 to 9 years of professional experience in data engineering or a related technical field.
  
• Demonstrate deep proficiency with Azure cloud services, specifically Azure Data Lake Storage (ADLS) and Azure Synapse Analytics.
  
• Show strong expertise in data modeling, data warehousing concepts, and the implementation of Delta Lake architecture.
  
• Be highly skilled in developing ETL pipelines using Azure Data Factory (ADF) and executing big data processing with PySpark.
  
• Have a solid command of Python and SQL for data manipulation, scripting, and query optimization.
  
• Experience working within Databricks environments for collaborative data analysis and engineering is essential.
  
• Target compensation range is approximately ₹24 LPA, commensurate with experience and skill level.