Azure Data Engineer

CloudDevs; India; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

A leading technology firm in India is seeking an experienced Azure Data Engineer to design, build, and maintain reliable data solutions on the Microsoft Azure platform. The ideal candidate will have over 5 years of experience with Big Data technologies, strong knowledge of Azure services, and proficiency in SQL. This position requires collaboration with cross-functional teams to implement data pipelines and ensure data quality. Join an innovative team where your expertise will contribute significantly to client success.

Qualifications

• 5+ years of experience with Big Data technologies.
• Experience using Azure Databricks in real-world scenarios.
• Relevant certifications in Azure data services or data engineering are a plus.

Responsibilities

• Design, develop, and implement scalable data solutions on Azure.
• Collaborate with teams to gather data requirements.
• Implement data quality measures and governance practices.

Skills

Microsoft Azure cloud platform

SQL proficiency

Apache Spark

Data integration and ETL processes

Problem-solving skills

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

Azure SQL Database

Azure Data Lake

Azure Blob Storage

Apache Hadoop

Azure Databricks

Job description

Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive increased value across their business ecosystem.

As an Azure Data Engineer, you will play a crucial role in designing, building, and maintaining scalable and reliable data solutions on the Microsoft Azure platform. You will work closely with cross-functional teams to understand data requirements, design and implement data ingestion pipelines, perform data integration and transformation, and implement data storage and retrieval mechanisms. You will also be responsible for monitoring data pipelines and implementing data quality and governance measures.

This is an exciting opportunity for a talented Data Engineer who is passionate about working with Azure technologies and wants to contribute to the success of our clients. If you have strong technical skills, a deep understanding of data engineering principles, and hands-on experience with Microsoft Azure, we would love to hear from you.

Responsibilities

• Design, develop, and implement scalable and reliable data solutions on the Microsoft Azure platform.
• Collaborate with cross-functional teams to gather and analyze data requirements.
• Design and implement data ingestion pipelines to collect data from various sources, ensuring data integrity and reliability.
• Perform data integration and transformation activities, ensuring data quality and consistency.
• Implement data storage and retrieval mechanisms, utilizing Azure services such as Azure SQL Database, Azure Data Lake, and Azure Blob Storage.
• Monitor data pipelines and troubleshoot issues to ensure smooth data flow and availability.
• Implement data quality measures and data governance practices to ensure data accuracy, consistency, and privacy.
• Collaborate with data scientists and analysts to support their data needs and enable data-driven insights.

Requirements

• Bachelor’s degree in Computer Science, Engineering, or a related field.
• 5+ years of experience with Big Data technologies
• Strong knowledge and experience with Microsoft Azure cloud platform
• Proficiency in SQL and experience with SQL-based database systems.
• Experience with batch and data streaming.
• Proficiency in data processing frameworks such as Apache Spark, Apache Hadoop, or cloud-native data processing services (Azure Data Lake, Azure Data factory, Azure Databricks, Azure Synapse, Snowflake, CosmosDB)
• Hands-on experience with Azure data services, such as Azure SQL Database, Azure Data Lake, and Azure Blob Storage.
• Experience using Azure Databricks in real-world scenarios.
• Experience with data integration and ETL (Extract, Transform, Load) processes.
• Strong analytical and problem-solving skills.
• Good understanding of data engineering principles and best practices.
• Experience with programming languages such as Python or Scala.
• Relevant certifications in Azure data services or data engineering are a plus.

About the company

Enable Data is a leading provider of advanced application, data and cloud engineering services. We have developed deep expertise across a number of industries and our consultants work with customers to leverage modern solutions to drive increased value across their business ecosystem.