Software Engineer - Azure Databricks Job

YASH Technologies Middle East

Hyderabad

On-site

INR 900,000 - 1,200,000

Full time

3 days ago

Be an early applicant

Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Job summary

YASH Technologies is seeking Azure Databricks professionals with 2–4 years of experience to design, build, and optimize scalable data pipelines on Azure. The role involves implementing ETL/ELT workflows, managing data lakes and warehouse solutions, and integrating AI/ML services into enterprise applications.

The ideal candidate will have hands-on Python, SQL, Spark, and strong Azure cloud skills, with experience in data governance, security, and cost optimization.

Qualifications

> Bachelor's or Master's degree in Computer Science, Information Technology, Data Science, or related field.
> 3 to 6 years of experience in Data Engineering and Azure Cloud technologies.
> Strong experience with Azure Data Factory, Databricks, Synapse Analytics, and Data Lake.
> Experience working with large-scale structured and semi-structured datasets.
> Knowledge of AI/ML integration and Generative AI solutions on Azure.
> Hands-on experience with Python, SQL, and Spark.
> Strong understanding of cloud architecture, security, and performance optimization.
> Experience with Agile development methodologies.

Responsibilities

Design, develop, and maintain scalable data pipelines using Azure services.
Build and optimize ETL/ELT workflows for structured and unstructured data.
Implement data ingestion solutions using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
Develop and manage data lakes and data warehouse solutions on Azure.
Integrate AI and Machine Learning services into enterprise applications.
Create and maintain data models, transformations, and processing frameworks.
Implement data governance, data quality, security, and compliance controls.
Monitor and optimize data platform performance, scalability, and cost.
Collaborate with Data Scientists, AI Engineers, Business Analysts, and Application Development teams.
Develop reusable frameworks and automation for data orchestration and deployment.
Support CI/CD implementation using Azure DevOps and IaC.
Troubleshoot data-related issues and provide production support.

Skills

Python

SQL

Spark

Education

Bachelor's or Master's in CS/IT/Data Science

Tools

Azure Data Factory

Azure Databricks

Azure Synapse Analytics

Data Lake

Job description

Job Description:

We use cookies to offer you the best possible website experience. Your cookie preferences will be stored in your browser’s local storage. This includes cookies necessary for the website's operation. Additionally, you can freely decide and change any time whether you accept cookies or choose to opt out of cookies to improve website's performance, as well as cookies used to display content tailored to your interests. Your experience of the site and the services we are able to offer may be impacted if you do not accept all cookies.

Location: Hyderabad, IN Pune, IN Indore, MP, IN Bangalore, KA, IN

Job Requisition Id: 66357

Date: Sep 16, 2026

YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation.

At YASH, we’re a cluster of the brightest stars working with cutting‑edge technologies. Our purpose is anchored in a single truth – bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future.

We are looking forward to hire Azure Databricks Professionals in the following areas :

Experience

2-4 Years

Key Responsibilities

Design, develop, and maintain scalable data pipelines using Azure services.
Build and optimize ETL/ELT workflows for structured and unstructured data.
Implement data ingestion solutions using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
Develop and manage data lakes and data warehouse solutions on Azure.
Integrate AI and Machine Learning services such as Azure AI Services, Azure OpenAI, Azure Machine Learning, and Cognitive Services into enterprise applications.
Create and maintain data models, transformations, and processing frameworks.
Implement data governance, data quality, security, and compliance controls.
Monitor and optimize data platform performance, scalability, and cost.
Collaborate with Data Scientists, AI Engineers, Business Analysts, and Application Development teams.
Develop reusable frameworks and automation for data orchestration and deployment.
Support CI/CD implementation using Azure DevOps and Infrastructure as Code (IaC).
Troubleshoot data-related issues and provide production support.

Azure AI & Machine Learning

Azure AI Services
Azure OpenAI Service
Azure Machine Learning
Azure Cognitive Services
Generative AI concepts and implementation

Required Qualifications

Bachelor's or Master's degree in Computer Science, Information Technology, Data Science, or related field.
3 to 6 years of experience in Data Engineering and Azure Cloud technologies.
Strong experience with Azure Data Factory, Databricks, Synapse Analytics, and Data Lake.
Experience working with large‑scale structured and semi‑structured datasets.
Knowledge of AI/ML integration and Generative AI solutions on Azure.
Hands‑on experience with Python, SQL, and Spark.
Strong understanding of cloud architecture, security, and performance optimization.
Experience with Agile development methodologies.

Preferred Qualifications

Microsoft Azure Certifications such as:

DP-203: Azure Data Engineer Associate
AI-102: Azure AI Engineer Associate
AZ-305: Azure Solutions Architect Expert

Experience with Microsoft Fabric.
Experience in Retrieval‑Augmented Generation (RAG) architectures.
Knowledge of Vector Databases and Semantic Search.
Experience integrating Azure OpenAI with enterprise applications.

At YASH, you are empowered to create a career that will take you to where you want to go while working in an inclusive team environment. We leverage career‑oriented skilling models and optimize our collective intelligence aided with technology for continuous learning, unlearning, and relearning at a rapid pace and scale.

Our Hyperlearning workplace is grounded upon four principles