Walk-in | Data Engineer

Hexaware Technologies; Hyderabad; Hybrid; INR 1,200,000 - 1,800,000; Full time

Job summary

Hexaware Technologies is seeking a data engineering professional to design, develop and optimise scalable ETL/ELT pipelines on Databricks. You will implement batch and streaming ingestion, build Bronze/Silver/Gold data layers using Delta Lake, and ensure governance with Unity Catalog and workflows within Azure data services.

The role emphasizes production-grade transformations via Python, PySpark, and SQL, along with performance tuning, data quality checks and automated deployments using CI/CD.

Qualifications

• Strong hands-on Databricks, Python/PySpark and SQL.
• Delta Lake and Databricks Workflows.
• ETL/ELT development and performance tuning.
• ADLS Gen2 and Azure data ecosystem.

Responsibilities

• Design, develop and optimise scalable ETL/ELT pipelines using Databricks.
• Develop production-grade data transformations using Python, PySpark and SQL.
• Build Bronze/Silver/Gold data layers using Delta Lake and medallion architecture.
• Implement batch and streaming ingestion patterns as required.
• Integrate Databricks with Azure data services including ADLS Gen2 and Synapse.
• Develop automated deployments using CI/CD and follow software engineering best practices.

Skills

Databricks

Python/PySpark

SQL

ETL/ELT development

Performance tuning

Tools

Delta Lake

Databricks Workflows

ADLS Gen2

Azure Synapse

Job description

Design, develop and optimise scalable ETL/ELT pipelines using Databricks.

Develop production-grade data transformations using Python, PySpark and SQL.

Build Bronze/Silver/Gold data layers using Delta Lake and medallion architecture.

Implement batch and, where required, streaming ingestion patterns.

Work with Databricks Workflows and Unity Catalog for orchestration and governance.

Integrate Databricks with Azure data services including ADLS Gen2 and Synapse.

Implement data-quality checks, error handling, monitoring and performance optimisation.

Develop automated deployments using CI/CD and follow software engineering best practices.

Troubleshoot production data pipelines and ensure reliability and scalability.

Mandatory skills:

• Strong hands-on Databricks, Python/PySpark and SQL.
• Delta Lake and Databricks Workflows.
• ETL/ELT development and performance tuning.
• ADLS Gen2 and Azure data ecosyst