Azure Data Engineer (Exp into Azure Databricks, Pyspark, SQL)

Adecco India; Pune District, Bengaluru; Hybrid; INR 1,200,000 - 1,800,000; Full time

Job summary

Adecco India is seeking an experienced Data Engineer to design and implement cloud-based data solutions in Azure, focusing on a medallion architecture and bronze/silver/gold data layers. You will build scalable pipelines and migrate data to cloud environments, collaborating with business ops teams.

The role requires hands-on expertise in Azure Databricks, Data Factory, PySpark, and SQL, with strong Python skills and experience leading agile scrum in fast-paced settings.

Qualifications

• 5-6 years of experience in Azure Cloud Data Engineering, Azure Databricks, datafactory , Pyspark, SQL,Python
• Hands on experience in Data Engineer, Azure Databricks, Data factory, Pyspark, SQL
• Proficient in Cloud Services Azure
• Architect and implement ETL and data movement solutions.

Responsibilities

• Design and implement data solutions using medallion architecture, ensuring effective organization and flow of data through bronze, silver, and gold layers.
• Supporting key business operations. This involves architecture designing, building and deploying data systems, pipelines etc
• Designing and implementing agile, scalable, and cost efficiency solution on cloud data services.
• Migrate data from traditional database systems to Cloud environment

Skills

Azure Data Engineering

Python

SQL

Pyspark

Communication

Tools

Azure Databricks

Azure Data Factory

Spark SQL

Jira

GitHub

Job description

Job Role & responsibilities:

• Design and implement data solutions using medallion architecture, ensuring effective organization and flow of data through bronze, silver, and gold layers.
• Supporting key business operations. This involves architecture designing, building and deploying data systems, pipelines etc
• Designing and implementing agile, scalable, and cost efficiency solution on cloud data services.
• Migrate data from traditional database systems to Cloud environment

Technical Skill, Qualification & experience required:

• 5-6 years of experience in Azure Cloud Data Engineering, Azure Databricks, datafactory , Pyspark, SQL,Python
• Hands on experience in Data Engineer, Azure Databricks, Data factory, Pyspark, SQL
• Proficient in Cloud Services Azure
• Architect and implement ETL and data movement solutions.
• Strong hands-on experience for working with Streaming dataset
• Building Complex Notebook in Databricks to achieve business Transformations.
• Hands-on Expertise in Data Refinement using Pyspark and Spark SQL
• Familiarity with building dataset using Scala.
• Familiarity with tools such as Jira and GitHub
• Experience leading agile scrum, sprint planning and review sessions
• Good communication and interpersonal skills
• Comfortable working in a multidisciplinary team within a fast-paced environment

* Immediate Joiners will be preferred only