Azure Data Engineer

Quest Global; Bengaluru; Híbrido; INR 3.000.000 - 6.000.000; Jornada completa

Descripción de la vacante

Quest Global is seeking an experienced Data Engineer for Bengaluru to lead end-to-end data solutions in a regulated environment. You will design, implement, and optimize large-scale data pipelines using Azure SQL, ADLS, Cosmos, and related services.

The role requires strong Python, Spark/Databricks expertise and hands-on Azure DevOps experience, with a focus on scalable, automated data architectures.

Formación

• 6+ years of experience in data engineering roles including leading end-to-end design and implementation of data solutions for large scale use cases.
• Experience designing solutions using databases and data storage technologies within Azure data management components such as Azure SQL, ADLS, Cosmos.
• Experience building, optimizing and automating data pipelines and data sets using MS Azure data management and processing components via IaaS/PaaS/SaaS.
• Proficiency in Python for data munging and scripting.
• Up-to-date with data processing platforms such as Spark (Databricks).
• Experience with Azure DevOps.

Responsabilidades

• 6+ years of experience of Data Engineering roles including 2+ years in leading end-to-end design and implementation of data solutions for large scale use cases.
• Experience in designing solutions using databases and data storage technology using Azure data management components - Azure SQL, ADLS, Cosmos.
• Experience building, optimizing and automating data pipelines, architectures and data sets using MS Azure data management and processing components through IaaS/PaaS/SaaS models.
• Proficiency in Python using different modules used for data munging.
• Be up to date with data processing technology / platforms such as Spark (Databricks).
• Experienced in Azure DevOps.

Conocimientos

Data engineering

Leadership

Python

Databricks

Azure DevOps

Azure data services

Herramientas

Informatica

DataStage

SSIS

Descripción del empleo

Role & responsibilities

1. 6+ years of experience of Data Engineering roles including 2+ years in leading end-to-end design and implementation of data solutions for large scale use cases
2. Experience in designing solutions using databases and data storage technology using Azure data management components - Azure SQL, ADLS, Cosmos
3. Experience building, optimizing and automating data pipelines, architectures and data sets using MS Azure data management and processing components through IaaS/PaaS/SaaS implementation models implemented through custom solutions
4. Proficiency in Python using different modules used for data munging
5. Be up to date with data processing technology / platforms such as Spark (Databricks)
6. Experienced in Azure DevOps

Preferred candidate profile

• Experience of working in tightly regulated industry is desirable
• Experience with ETL and/or data integration tool such as Informatica, DataStage, SSIS is highly desirable
• Good understanding of Azure infrastructure components and their fit in different types of data solutions