Senior Azure Data Engineer

KPI Partners; Bengaluru; On-site; INR 1,200,000 - 1,600,000; Full time

Job summary

A leading IT consulting firm in Bengaluru is looking for an experienced Azure Data Engineer to design, implement, and maintain data solutions in the Azure cloud environment. The ideal candidate will have at least 6 years of experience in data engineering, strong proficiency in SQL and Python, as well as experience with Azure services and big data technologies like Spark and PySpark. This full-time position offers an exciting opportunity to work collaboratively in a dynamic team.

Qualifications

• Minimum of 6 years of experience in data engineering or related fields.
• Proficiency in SQL for data manipulation and querying.
• Strong programming skills in Python, with experience in data processing libraries.
• Familiarity with Azure cloud services, including Azure Data Factory, Azure Databricks, and Azure SQL Database.
• Experience with big data technologies, specifically Spark and Pyspark, for data processing and analysis.
• Excellent problem-solving skills and ability to work collaboratively in a team environment.

Responsibilities

• Design and develop scalable data pipelines and infrastructure on Azure.
• Optimize data storage and retrieval processes to ensure high performance and efficiency.
• Collaborate with data scientists, analysts, and business stakeholders to gather requirements and provide effective data solutions.
• Implement data integration and transformation processes using Azure data services.
• Monitor and troubleshoot data systems to ensure accuracy and reliability.
• Stay updated with industry best practices and emerging technologies in data engineering and Azure services.

Skills

SQL

Python

Azure

Spark

PySpark

Job description

KPI Partners is seeking a highly skilled Azure Data Engineer with a strong background in data engineering and analytics. The successful candidate will be responsible for designing, implementing, and maintaining data solutions in the Azure cloud environment.

The ideal candidate will have a minimum of 6 years of experience in data engineering, with expertise in SQL, Python, Azure, Spark, and PySpark.

Key Responsibilities:

• Design and develop scalable data pipelines and infrastructure on Azure.
• Optimize data storage and retrieval processes to ensure high performance and efficiency.
• Collaborate with data scientists, analysts, and business stakeholders to gather requirements and provide effective data solutions.
• Implement data integration and transformation processes using Azure data services.
• Monitor and troubleshoot data systems to ensure accuracy and reliability.
• Stay updated with industry best practices and emerging technologies in data engineering and Azure services.

Required Skills and Qualifications:

• Minimum of 6 years of experience in data engineering or related fields.
• Proficiency in SQL for data manipulation and querying.
• Strong programming skills in Python, with experience in data processing libraries.
• Familiarity with Azure cloud services, including Azure Data Factory, Azure Databricks, and Azure SQL Database.
• Experience with big data technologies, specifically Spark and Pyspark, for data processing and analysis.
• Excellent problem‑solving skills and ability to work collaboratively in a team environment.

Seniority level

• Mid‑Senior level

Employment type

• Full‑time

Job function

• Consulting

Industries

• IT Services and IT Consulting