Azure Data Engineer - 5 DAYS WFO - Bangalore

Quess IT Solutions; Bengaluru; On-site; INR 1,800,000 - 2,800,000; Full time

Job summary

Quess IT Solutions is seeking a Senior Data Engineer to design and build scalable data pipelines using Databricks in the Azure data ecosystem. You will collaborate with onsite teams to translate business requirements into robust data solutions and ensure end-to-end delivery.

The role requires strong PySpark, Python, SQL, and experience with Azure services such as ADF, ADLS, Blob Storage, and Key Vault. You will optimize data workflows and partner with stakeholders across teams.

Qualifications

• 5+ years of hands-on experience with Databricks.
• Strong PySpark and Python development skills.
• Solid knowledge of Azure cloud services (ADF, ADLS, Blob Storage, Key Vault).
• Experience with data ingestion, connectors and integration frameworks.
• Strong SQL skills with performance tuning.
• Understanding of data architecture and DWH concepts.
• Good communication and stakeholder management.

Responsibilities

• Collaborate with onsite team to gather and translate end-to-end requirements.
• Design, build, and maintain scalable data pipelines using Databricks, PySpark, and Python.
• Work across Azure services including ADF, ADLS, Blob Storage, and Key Vault.
• Build and manage data ingestion workflows and integration frameworks across sources.
• Write and optimize complex SQL queries with performance focus.
• Apply data architecture and DWH best practices for robust solutions.
• Partner with stakeholders across teams to ensure alignment and timely delivery.

Skills

Databricks

PySpark

Python

SQL

Data Warehousing

Data Architecture

Stakeholder Management

Tools

Azure Data Factory (ADF)

Azure Data Lake Storage (ADLS)

Azure Blob Storage

Key Vault

Job description

About the Role:

We're looking for a Senior Data Engineer with strong hands‑on expertise in Databricks and the Azure data ecosystem to join our team. You'll play a key role in designing and building scalable data pipelines, working closely with our onsite team to understand and deliver end-to-end data requirements.

What You'll Do:

• Collaborate with the onsite team to gather, understand, and translate end-to-end business and technical requirements
• Design, build, and maintain scalable data pipelines using Databricks, PySpark, and Python
• Work across Azure services including Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Blob Storage, and Key Vault for secure and efficient data integration
• Build and manage data ingestion workflows, connectors, and integration frameworks across multiple source systems
• Write and optimize complex SQL queries, with a strong focus on performance tuning
• Apply data architecture and data warehousing (DWH) best practices to ensure robust, well‑structured solutions
• Partner with stakeholders across teams to ensure alignment on data solutions and timely delivery

What We're Looking For:

• 5+ years of hands‑on experience with Databricks
• Strong development experience in PySpark and Python
• Solid working knowledge of Azure Cloud Services (ADF, ADLS, Blob Storage, Key Vault, etc.)
• Experience with data ingestion, connectors, and integration frameworks
• Strong SQL skills with a proven track record in performance tuning
• Experience designing and delivering scalable data pipelines
• Good understanding of data architecture and DWH concepts
• Strong communication skills and the ability to manage stakeholders effectively