MS Azure with ADF, Databricks

Cloudxtreme; Hyderabad, Bengaluru; Hybrid; INR 1,500,000 - 2,100,000; Full time

Job summary

Cloudxtreme is seeking a seasoned Data Engineer to design and optimize end-to-end data pipelines using Databricks and Azure cloud services at Hyderabad or Bangalore. This onsite role expects 4-5 years of Databricks experience and a hands-on approach.

You will build ETL/ELT processes for ingestion, transformation, and transmission, collaborate with data teams to implement scalable solutions, and perform continuous performance tuning of data workflows.

Qualifications

• Must-Have Technical Skills listed in the job post.

Responsibilities

• Design, develop, and optimize data pipelines using Databricks, ADF, and Azure cloud services
• Build ETL/ELT processes for data ingestion, transformation, and transmission
• Collaborate with data teams to implement scalable data solutions
• Performance tuning and monitoring of data workflows

Skills

Databricks Data Engineering

PySpark

Python

Scala

Azure Cloud

ETL/Data Pipelines

SQL

Data Transmission

Job description

Role & responsibilities

Locations: Hyderabad & Bangalore
Work Mode: 5 Days a Week Onsite (WHO)
Experience Level:

• 4-5 years relevant experience in Databricks (Total: 6-8 years)
• OR 6+ years relevant experience in Databricks (Total: 8-12 years)
  Joining: Immediate Joiners Only

Key Responsibilities

• Design, develop, and optimize data pipelines using Databricks, ADF, and Azure cloud services
• Build ETL/ELT processes for data ingestion, transformation, and transmission
• Collaborate with data teams to implement scalable data solutions
• Performance tuning and monitoring of data workflows

Must-Have Technical Skills

• Databricks Data Engineering (Core expertise required)
• PySpark, Python, Scala
• Azure Cloud (ADF, Data Lake, Synapse, etc.)
• ETL/Data Pipelines in cloud environments
• SQL (Advanced querying and optimization)
• Data Transmission protocols and tools