Databricks Data Engineer

Cloudxtreme; Hyderabad, Bengaluru; On-site; INR 1,400,000 - 2,200,000; Full time

Job summary

Cloudxtreme in Hyderabad, India seeks a hands-on data engineer skilled in Azure Databricks, Apache Spark/Scala to design and maintain robust data pipelines. You will work with SQL, build ETL processes in Azure, and apply Terraform for infrastructure as code and pipeline deployment.

You will collaborate with DevOps teams on CI/CD and Git workflows, troubleshoot and document data workflows, and help optimize performance at scale in a cloud-first environment.

Qualifications

• Hands-on experience with Azure Databricks and Spark/Scala.
• Proficient in Scala and SQL for data engineering tasks.
• Experience building and maintaining ETL pipelines in Azure.
• Familiarity with infrastructure as code using Terraform.
• Knowledge of DevOps practices including CI/CD and version control with Git.
• Ability to troubleshoot, optimize, and document data workflows.

Responsibilities

• Hands-on experience with Azure Databricks and Apache Spark/Scala.
• Proficiency in Scala, and SQL for data engineering tasks
• Experience building and maintaining ETL pipelines in Azure
• Strong working knowledge of Terraform for infrastructure as code and pipeline deployment
• Familiarity with DevOps practices (e.g., CI/CD, version control with Git)
• Ability to troubleshoot, optimize, and document data workflows

Skills

Azure Databricks

Apache Spark/Scala

Scala

SQL

Azure ETL pipelines

Terraform

DevOps CI/CD

Git

Data workflow troubleshooting

Tools

Terraform

Git

Job description

Role & responsibilities

• Hands-on experience with Azure Databricks and Apache Spark/Scala
• Proficiency in Scala, and SQL for data engineering tasks
• Experience building and maintaining ETL pipelines in Azure
• Strong working knowledge of Terraform for infrastructure as code and pipeline deployment
• Familiarity with DevOps practices (e.g., CI/CD, version control with Git)
• Ability to troubleshoot, optimize, and document data workflows