Senior Data Engineer

Perficient India; Bengaluru; Hybrid; INR 7,000,000 - 7,001,000; Full time

Job summary

Perficient India is seeking a Lead Azure Databricks Engineer to design, build, and optimize scalable data pipelines on the Azure platform. You will collaborate with data analysts and business teams to deliver reliable datasets, using Azure Databricks, PySpark, SQL and Python.

Ideal candidates have 7+ years of experience, strong problem-solving skills and are comfortable working in a hybrid model with some in-office days.

Qualifications

• 7+ years of experience in Azure Databricks engineering.
• Strong hands-on skills in Azure Databricks, PySpark, SQL and Python.
• Understanding of ETL/ELT concepts and data warehousing.
• Familiarity with Azure ecosystem tools is a plus.
• Good problem-solving and communication skills.

Responsibilities

• Design and maintain ETL/ELT pipelines using Azure Databricks.
• Write efficient PySpark and Python code for large-scale data processing.
• Develop and optimize complex SQL queries for data transformation and reporting.
• Work with Delta Lake, ADLS, and Azure Data Factory.
• Monitor and troubleshoot pipeline performance.
• Collaborate with data analysts and business teams to deliver reliable datasets.

Skills

Azure Databricks

PySpark

SQL

Python

ETL/ELT

Azure Data Factory

Tools

Azure Data Factory

Delta Lake

ADLS

Job description

We are looking for a Lead Azure Databricks Engineer

Locations: #Hyderabad |#Bangalore | #Chennai | #Pune | #Nagpur

Experience: 7+ Years

Employment Type: Full-time | Hybrid (3 days work from office)

Interview Mode: Virtual followed by mandatory in-person

Notice Period: Immediate Joiners Only

Job Description:

We are looking for a skilled Data Engineer with strong expertise in Azure Databricks, PySpark, SQL, and Python to join our team. The ideal candidate will design, build, and optimize scalable data pipelines and support analytics initiatives on the Azure platform.

Responsibilities:

• Design and maintain ETL/ELT pipelines using Azure Databricks


• Write efficient PySpark and Python code for large-scale data processing


• Develop and optimize complex SQL queries for data transformation and reporting


• Work with Delta Lake, Azure Data Lake Storage (ADLS), and Azure Data Factory


• Monitor and troubleshoot pipeline performance


• Collaborate with data analysts and business teams to deliver reliable datasets

Requirements:

• 7+ years of experience in Azure Databricks Engineer


• Strong hands-on skills in Azure Databricks, PySpark, SQL, and Python


• Understanding of data pipeline design, ETL/ELT concepts, and data warehousing


• Familiarity with Azure ecosystem tools is a plus


• Good problem-solving and communication skills

Preferred Certifications

• Microsoft Certified: Azure Solutions Architect Expert