Azure Data Engineer

PradeepIT Consulting Services Pvt Ltd; Bengaluru; On-site; INR 1,000,000 - 1,500,000; Full time

Job summary

A dynamic IT consulting firm is seeking an experienced Data Engineer to design and optimize data pipelines using Azure technologies. Ideal candidates will have at least 5 years of experience, strong Azure expertise, and a proficiency in Agile methodologies. The role involves close collaboration with client teams to implement effective data solutions, ensuring quality and scalability.

Qualifications

• At least 5 years of experience as a data engineer with strong expertise in Azure.
• Proficiency in Azure, ADLS, ADF, and Synapse Analytics.
• Hands-on experience with Agile software development.

Responsibilities

• Design and implement data pipelines using Azure technologies.
• Optimize data pipelines for performance and scalability.
• Work in a team following Agile practices.

Skills

Azure Data Factory

Data Engineering

Agile methodologies

ETL/ELT technologies

Education

Bachelor's degree in Computer Science or related field

Tools

Azure Databricks

Azure ADLS

Synapse Analytics

Job description

• Design and implement data pipelines using Azure technologies such as Azure Data Factory, CDC, Azure Stream Analytics, and Azure Synapse
• Optimize data pipelines for performance and scalability using Azure Databricks
• Optimize data storage and data quality
• Use of ETL/ELT technology (Extract, Transform, Load)
• Work in the team following Agile practices
• Work in close cooperation with client teams to find the best solutions
• Support exploration and sales of new market trends to ensure growth with interesting projects that leverage the latest technologies

Requirements for the Role

• Bachelors degree in Computer Science or related field
• At least 5 years of experience as a data engineer with strong expertise in azure
• Proficiency in Azure, ADLS, ADF and Synapse analytics
• Hands-on experience with Agile software development