Azure Data Engineer

Sonyo Management Consultants; Hyderabad, Bangalore Rural; On-site; INR 1,500,000 - 2,100,000; Full time

Job summary

Sonyo Management Consultants in Hyderabad/Bangalore is seeking an Azure Databricks Engineer to design, develop, and optimize scalable data pipelines on the Microsoft Azure platform. The role demands deep hands-on expertise with Azure Databricks, Spark, and Python, plus strong SQL and data modeling skills.

The ideal candidate will craft robust data solutions, collaborate across teams, and ensure high-performance data processing for large-scale datasets.

Qualifications

• 612 years of experience in Data Engineering.
• Strong hands-on experience with Azure Databricks.
• Expertise in Apache Spark (PySpark/Scala Spark).
• Strong programming skills in Python.
• Experience with SQL and performance tuning.
• Hands-on experience with Azure Data Factory (ADF).
• Experience with Azure Data Lake Storage (ADLS Gen2).
• Good understanding of Delta Lake and Medallion Architecture.
• Experience in Azure Synapse Analytics.
• Knowledge of Git, Azure DevOps, and CI/CD pipelines.
• Understanding of data modeling and data warehousing concepts.
• Experience in handling large-scale datasets and distributed computing.
• Strong analytical and problem-solving skills.

Responsibilities

• Design scalable data engineering solutions on Microsoft Azure.
• Develop and optimize data pipelines and data models.
• Collaborate with cross-functional teams to deliver end-to-end workloads.
• Tuning performance and implementing best practices for data processing.

Skills

Data Engineering

Azure Databricks

PySpark/Scala Spark

Python

SQL

Azure Data Factory

ADLS Gen2

Delta Lake

Azure Synapse Analytics

Git / Azure DevOps / CI/CD

Data Modeling

Distributed Computing

Analytical Skills

Education

Bachelor's or Master's in CS/IT/Engineering

Tools

Azure Databricks

Azure Data Factory

Azure Data Lake Storage Gen2

Delta Lake

Azure Synapse Analytics

Git

Azure DevOps

CI/CD Pipelines

Job description

Job Title: Azure Databricks Engineer

Experience: 612 Years

Location: Hyderabad / Bangalore

Job Summary

We are seeking an experienced Azure Databricks Engineer with 612 years of experience in designing, developing, and optimizing scalable data engineering solutions on the Microsoft Azure platform.

Required Skills

• 612 years of experience in Data Engineering.


• Strong hands-on experience with Azure Databricks.


• Expertise in Apache Spark (PySpark/Scala Spark).


• Strong programming skills in Python.


• Experience with SQL and performance tuning.


• Hands-on experience with Azure Data Factory (ADF).


• Experience with Azure Data Lake Storage (ADLS Gen2).


• Good understanding of Delta Lake and Medallion Architecture.


• Experience working with Azure Synapse Analytics.


• Knowledge of Git, Azure DevOps, and CI/CD pipelines.


• Understanding of data modeling and data warehousing concepts.


• Experience in handling large-scale datasets and distributed computing.


• Strong analytical and problem-solving skills.

Educational Qualification

• Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.