Data Engineer (Azure Data Platforms)

Vrinda International; Bengaluru; On-site; INR 900,000 - 1,100,000; Full time

Job summary

Vrinda International is seeking a Data Engineer to design, build, and maintain scalable data pipelines in the IT Services domain. You will leverage Azure Data Factory, Databricks, and Synapse to ensure data integrity and accessibility, while enabling real-time processing with Airflow and Kafka.

Responsibilities include governance via Azure Purview, Cosmos DB and Blob Storage optimization, and collaboration with cross-functional teams to translate requirements into scalable architectures.

Qualifications

• 3–6 years of hands-on experience in data engineering within the IT Services industry.

Responsibilities

• Architect and develop end-to-end data solutions utilizing the Azure ecosystem, including Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
• Implement real-time data streaming and processing capabilities using Apache Airflow, Kafka, and Azure Functions.
• Manage and optimize data storage strategies across Cosmos DB and Blob Storage to ensure high availability and performance.
• Establish comprehensive data governance and lineage tracking frameworks using Azure Purview to maintain compliance and data quality.
• Collaborate with cross-functional teams to translate business requirements into technical data specifications and scalable architectures.
• Monitor data pipeline performance, troubleshoot issues, and implement continuous improvements to enhance system efficiency.

Skills

Data engineering

Azure data services

NoSQL databases

Stream processing

Data governance

Cross-functional collaboration

Tools

Azure Data Factory

Azure Databricks

Azure Synapse Analytics

Azure Functions

Cosmos DB

Blob Storage

Apache Airflow

Kafka

Azure Purview

Job description

Welcome to Vrinda International's Talent Portal

Discover your next career milestone with Vrinda International, a leading recruitment firm specializing in IT talent acquisition, international education consultancy, and language coaching opportunities. Our portal streamlines your job search with cutting-edge Applicant Tracking System (ATS) technology.

Why Choose Us?

• Advanced Matching: Our AI-driven tools match your skills to top IT, business development, and overseas study consultancy positions.
  
• Exclusive Opportunities: Access hidden job markets, visa guidance for international roles, and personalized career coaching.
  

Job Description

Summary

We are seeking a skilled Data Engineer to design, build, and maintain robust data solutions within the IT Services sector. In this pivotal role, you will leverage advanced Azure technologies to architect scalable data pipelines and ensure the integrity and accessibility of critical business information. Your expertise will drive the optimization of data workflows, enabling seamless integration across diverse platforms and supporting strategic decision-making through reliable data infrastructure.

Responsibilities

• Architect and develop end-to-end data solutions utilizing the Azure ecosystem, including Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
  
• Implement real-time data streaming and processing capabilities using Apache Airflow, Kafka, and Azure Functions.
  
• Manage and optimize data storage strategies across Cosmos DB and Blob Storage to ensure high availability and performance.
  
• Establish comprehensive data governance and lineage tracking frameworks using Azure Purview to maintain compliance and data quality.
  
• Collaborate with cross-functional teams to translate business requirements into technical data specifications and scalable architectures.
  
• Monitor data pipeline performance, troubleshoot issues, and implement continuous improvements to enhance system efficiency.
  

Requirements

Requirements:

• Possess 3-6 years of hands-on professional experience in data engineering within the IT Services industry.
  
• Demonstrate proven proficiency with Azure data services, specifically Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Functions.
  
• Exhibit strong expertise in managing NoSQL databases (Cosmos DB) and object storage solutions (Blob Storage).
  
• Have practical experience implementing streaming data architectures using Apache Airflow and Kafka.
  
• Understand and apply data governance principles using tools like Azure Purview.
  
• Hold a competitive salary expectation aligned with the market rate of ₹10 LPA for the specified experience level.