Databricks Engineer

Canterr It Services; Hyderabad; Hybrid; INR 1,200,000 - 2,100,000; Full time

Job summary

Canterr It Services is seeking a highly skilled Data Engineer in Hyderabad to join our team. The role focuses on data engineering, ETL/ELT pipelines, and big data processing across Azure-based tech stack, including Databricks, Spark, PySpark, and Delta Lake.

The ideal candidate has extensive experience with Python, SQL, and Azure data services, and will contribute to lakehouse architectures, data modeling, and governance practices within secure Azure environments.

Qualifications

• 68 years of experience in data engineering, ETL development, or big data processing.
• Strong hands-on experience with Azure Databricks. Proficiency in Apache Spark and PySpark.
• Strong programming skills in Python and SQL. Experience with Azure Data Lake Storage Gen2.
• Experience developing pipelines using Azure Data Factory.
• Practical knowledge of Delta Lake and lakehouse architecture.
• Experience working with relational and NoSQL databases.
• Strong understanding of data modeling, ETL/ELT concepts, and data warehousing.
• Experience with Git-based source control and CI/CD practices.
• Knowledge of Azure services such as: Azure Key Vault Azure Synapse Analytics Azure SQL Database Azure Event Hubs Azure Monitor Experience with data security, access control, and governance in Azure environments.

Skills

Data engineering

ETL/ELT

Big data

Python

SQL

Data modeling

Data warehousing

Git

CI/CD

Data governance

Tools

Azure Databricks

Apache Spark

PySpark

Azure Data Lake Storage Gen2

Azure Data Factory

Delta Lake

lakehouse

Relational databases

NoSQL databases

Azure Key Vault

Azure Synapse Analytics

Azure SQL Database

Azure Event Hubs

Azure Monitor

Job description

• Experience and Qualification:68 years of experience in data engineering, ETL development, or big data processing.
• Strong hands-on experience with Azure Databricks. Proficiency in Apache Spark and PySpark.
• Strong programming skills in Python and SQL. Experience with Azure Data Lake Storage Gen2.
• Experience developing pipelines using Azure Data Factory.
• Practical knowledge of Delta Lake and lakehouse architecture.
• Experience working with relational and NoSQL databases.
• Strong understanding of data modeling, ETL/ELT concepts, and data warehousing.
• Experience with Git-based source control and CI/CD practices.
• Knowledge of Azure services such as: Azure Key Vault Azure Synapse Analytics Azure SQL Database Azure Event Hubs Azure Monitor Experience with data security, access control, and governance in Azure environments.