Data Engineer (Azure Databricks)

WOW Softech; Gurugram District; On-site; INR 1,200,000 - 1,900,000; Full time

Job summary

WOW Softech is seeking an experienced Data Engineer to design and optimize scalable data pipelines using Azure Databricks and Delta Lake. The role focuses on building robust ETL/ELT processes, data modeling, and data governance in a cloud-first environment.

The ideal candidate will have hands-on experience with PySpark, Python, SQL, and Azure Data Factory, delivering reliable data solutions for analytics and reporting across multiple domains.

Qualifications

• 6–10 years of data engineering experience.
• Hands-on expertise with Azure Databricks and cloud data platforms.
• Proficient in PySpark, Python and SQL for ETL/ELT pipelines.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using Azure Databricks and Azure Data Factory.
• Build high-performance data solutions using PySpark, Python, and SQL.
• Develop and optimize data models, warehouses, and Delta Lake architectures.
• Implement and maintain Delta Live Tables, Auto Loader, and Unity Catalog.
• Optimize data processing workflows and perform performance tuning for large-scale datasets.
• Work with ADLS and other Azure services for data ingestion and processing.
• Ensure data quality, governance, security, and compliance across the data platform.
• Collaborate with stakeholders, analysts, and engineers to deliver data solutions.
• Automate data workflows and monitoring to improve operations.
• Troubleshoot production issues and maintain SLAs.
• Follow coding, version control, and CI/CD best practices.

Skills

Data engineering

Azure Cloud

PySpark

Python

SQL

ETL/ELT pipelines

Data modeling

Performance tuning

Stakeholder communication

CI/CD for data projects

Tools

Azure Databricks

Azure Data Factory

Azure Data Lake Storage

Delta Lake

Delta Live Tables

Auto Loader

Unity Catalog

Job description

Job Description Data Engineer (Azure Databricks)

Job Title: Data Engineer – Azure Databricks
Experience: 7–10 Years
Location: Gurugram , Bangalore (Local Candidates )
Employment Type: Full-Time

Job Summary

We are seeking an experienced Data Engineer with strong expertise in Azure Cloud and Databricks to design, build, and optimize scalable data pipelines. The ideal candidate will have hands-on experience in PySpark, Python, SQL, Azure Data Factory, Azure Data Lake, and Delta Lake, with a strong understanding of modern data engineering practices and cloud-based data platforms.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines using Azure Databricks and Azure Data Factory.
• Build high-performance data solutions using PySpark, Python, and SQL.
• Develop and optimize data models, data warehouses, and Delta Lake architectures.
• Implement and maintain Delta Live Tables (DLT), Auto Loader, and Unity Catalog.
• Optimize data processing workflows and perform performance tuning for large-scale datasets.
• Work with Azure Data Lake Storage (ADLS) and other Azure cloud services for data ingestion and processing.
• Ensure data quality, governance, security, and compliance across the data platform.
• Collaborate with business stakeholders, data analysts, and engineering teams to understand business requirements and deliver data solutions.
• Automate data workflows and monitoring processes to improve operational efficiency.
• Troubleshoot production issues and provide timely resolutions while maintaining SLAs.
• Follow best practices in coding, version control, and CI/CD for data engineering projects.

Required Skills

• 6–10 years of experience in Data Engineering.
• Strong hands-on experience with Azure Databricks.
• Expertise in PySpark, Python, and SQL.
• Experience in Azure Data Factory (ADF).
• Experience with Azure Data Lake Storage (ADLS).
• Strong knowledge of ETL/ELT pipeline development.
• Experience with Delta Lake and modern data warehousing concepts.
• Hands-on experience with Delta Live Tables (DLT).
• Experience with Auto Loader.
• Experience with Unity Catalog.
• Strong understanding of data modeling.
• Experience in performance tuning and optimization of data pipelines.
• Excellent analytical and problem-solving skills.
• Strong communication and stakeholder management skills.