Sr. Software Engineer - Azure Databricks Job

YASH Technologies, Inc.; Hyderabad; On-site; INR 2,400,000 - 4,200,000; Full time

Job summary

YASH Technologies, a leading technology integrator, invites Azure Databricks professionals to join our Hyderabad-based data engineering team.

The Senior Software Engineer will design and deliver enterprise-scale data solutions on Azure, leveraging Databricks, Spark, and Azure-native services to support analytics and digital transformation initiatives. You will collaborate with architects, data scientists, and developers in an Agile environment.

Qualifications

• Experience with Azure Databricks, Spark, and PySpark.
• Hands-on with Azure Data Factory.
• Proficiency in SQL and Python.
• Experience with Delta Lake and Lakehouse architecture.
• Strong knowledge of ADLS Gen2.
• Experience with Azure DevOps, Git, CI/CD.
• Knowledge of Azure Synapse Analytics and Azure SQL.
• Expert in data modeling, performance tuning, and warehousing.
• Strong analytical and communication skills.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Azure Databricks and PySpark.
• Build and optimize ETL/ELT workflows for large datasets.
• Develop data solutions using Delta Lake and Lakehouse architecture.
• Collaborate with stakeholders and teams to deliver end-to-end data solutions.
• Implement CI/CD pipelines and ensure security governance.

Skills

Azure Databricks

Apache Spark

PySpark

Azure Data Factory

SQL

Python

Delta Lake

Lakehouse

ADLS Gen2

Azure DevOps

Git

CI/CD

Azure Synapse

Azure SQL

Azure Key Vault

Data modeling

Performance tuning

Communication

Tools

Azure Monitor

Unity Catalog

Job description

Select how often (in days) to receive an alert: Create Alert

Date: Oct 6, 2026

Job Requisition Id: 66256

Location: Hyderabad, TG, IN Hyderabad, IN

YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation.

At YASH, we’re a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single truth – bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future.

We are looking forward to hire Azure Databricks Professionals in the following areas :

• Design, develop, and maintain scalable data pipelines using Azure Databricks, PySpark, and Azure Data Factory (ADF).
• Build and optimize ETL/ELT workflows for processing large-scale structured and unstructured datasets.
• Develop data solutions using Delta Lake and Medallion Architecture (Bronze, Silver, Gold layers).
• Integrate data from multiple sources including databases, APIs, cloud storage, and enterprise applications.
• Implement data transformation, cleansing, validation, and quality frameworks.
• Optimize Spark jobs, cluster configurations, and SQL queries to improve performance and reduce costs.
• Develop and maintain data models supporting business intelligence, reporting, and analytics requirements.
• Utilize Azure services such as ADLS Gen2, Azure Synapse Analytics, Azure SQL Database, Key Vault, and Azure Monitor.
• Implement CI/CD pipelines using Azure DevOps and Git-based version control practices.
• Ensure data security, governance, compliance, and access management using Unity Catalog and Azure security best practices.
• Monitor production workloads, troubleshoot data issues, and perform root cause analysis.
• Collaborate with business stakeholders, solution architects, data scientists, and development teams to deliver end-to-end data solutions.
• Participate in Agile ceremonies, code reviews, design discussions, and technical mentoring of junior team members.
• Support cloud migration and modernization initiatives from on-premises platforms to Azure.

2. Required Skills

• Strong experience in Azure Databricks, Apache Spark, and PySpark.
• Hands-on experience with Azure Data Factory (ADF).
• Proficiency in SQL and Python.
• Experience with Delta Lake and Lakehouse Architecture.
• Strong understanding of Azure Data Lake Storage (ADLS Gen2).
• Experience with Azure DevOps, Git, and CI/CD implementations.
• Knowledge of Azure Synapse Analytics, Azure SQL Database, and Azure Key Vault.
• Expertise in data modeling, performance tuning, and data warehousing concepts.
• Strong analytical, problem-solving, and communication skills.

Role Summary:
The Senior Software Engineer will be responsible for designing and delivering enterprise-grade data engineering solutions on Azure, leveraging Databricks, Spark, and Azure-native services to support business intelligence, analytics, and digital transformation initiatives.

At YASH, you are empowered to create a career that will take you to where you want to go while working in an inclusive team environment.We leverage career-oriented skilling models and optimize our collective intelligence aided with technology for continuous learning, unlearning, and relearning at a rapid pace and scale.

Our Hyperlearning workplace is grounded upon four principles

• Flexible work arrangements, Free spirit, and emotional positivity
• Agile self-determination, trust, transparency, and open collaboration
• All Support needed for the realization of business goals,
• Stable employment with a great atmosphere and ethical corporate culture