Azure Data Engineer - SQL, Python, Pyspark, Azure, Fabric

KPI Partners; Hyderabad, Pune District, Bengaluru; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

KPI Partners is seeking an Azure Data Engineer to design and implement scalable data solutions on Azure. You will work with data scientists and analysts to ensure data availability for analysis and decision-making.

Responsibilities include building ETL pipelines, leveraging SQL, Python, and PySpark, and ensuring secure, compliant data storage. Collaboration across teams and focus on performance and reliability are key.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Proven experience as a Data Engineer with a strong background in Azure technologies.
• Proficiency in SQL, Python, and PySpark for data manipulation and analysis.
• Familiarity with Azure Fabric and cloud-based data solutions.
• Strong problem-solving skills and attention to detail.
• Excellent communication and collaboration abilities.

Responsibilities

• Design, build, and maintain data pipelines and ETL processes using Azure services.
• Utilize SQL, Python, and Pyspark for data processing and transformation tasks.
• Implement data storage solutions using Azure Fabric and ensure efficient data retrieval.
• Collaborate with cross-functional teams to gather requirements and translate them into technical specifications.
• Optimize data workflows to enhance performance and scalability.
• Monitor and troubleshoot data pipeline issues, providing timely resolutions.
• Ensure data security and compliance with organizational standards.

Skills

Problem-solving

Communication

Collaboration

Cloud familiarity

Education

Bachelor's degree in Computer Science or IT

Tools

Azure Fabric

SQL

Python

PySpark

Job description

KPI Partners is seeking a skilled Azure Data Engineer to join our dynamic team. In this role, you will be responsible for designing and implementing data solutions that leverage Azure technologies. You will work collaboratively with data scientists, analysts, and other stakeholders to develop scalable data pipelines, ensuring the integrity and availability of data for analysis and decision-making.

Key Responsibilities:

• Design, build, and maintain data pipelines and ETL processes using Azure services.


• Utilize SQL, Python, and Pyspark for data processing and transformation tasks.


• Implement data storage solutions using Azure Fabric and ensure efficient data retrieval.


• Collaborate with cross-functional teams to gather requirements and translate them into technical specifications.


• Optimize data workflows to enhance performance and scalability.


• Monitor and troubleshoot data pipeline issues, providing timely resolutions.


• Ensure data security and compliance with organizational standards.

Qualifications:

• Bachelor's degree in Computer Science, Information Technology, or a related field.


• Proven experience as a Data Engineer with a strong background in Azure technologies.


• Proficiency in SQL, Python, and Pyspark for data manipulation and analysis.


• Familiarity with Azure Fabric and cloud-based data solutions.


• Strong problem-solving skills and attention to detail.


• Excellent communication and collaboration abilities.

Preferred Skills:

• Experience with data modeling, data warehousing, and data visualization tools.


• Knowledge of machine learning frameworks and data analytics concepts.

Join KPI Partners and be a part of a forward-thinking company that values innovation and collaboration.