Software Engineer - Azure Databricks

YASH Technologies, Inc.; Hyderabad; In loco; INR 1.200.000 - 2.400.000; Tempo pieno

Descrizione del lavoro

YASH Technologies, Inc. is seeking an experienced Azure Databricks Professional to design, develop, and maintain scalable data and AI solutions on Microsoft Azure. The role focuses on data pipelines, ETL/ELT workflows, and integration of AI services.

The ideal candidate will have hands-on experience with Azure Data Factory, Databricks, Synapse Analytics, and Data Lake, plus Python, SQL, and Spark. Strong knowledge of cloud architecture, security, and Agile practices is required.

Competenze

• 3 to 6 years of experience in Data Engineering and Azure cloud technologies.
• Proficiency with Azure Data Factory, Databricks, Synapse Analytics, and Data Lake.
• Experience with large-scale structured and semi-structured datasets.
• Hands-on Python, SQL, and Spark.
• Knowledge of AI/ML integration and Generative AI solutions on Azure.
• Experience with Agile development methodologies.

Mansioni

• Design, develop, and maintain scalable data pipelines using Azure services.
• Build and optimize ETL/ELT workflows for structured and unstructured data.
• Implement data ingestion solutions using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
• Develop and manage data lakes and data warehouse solutions on Azure.
• Integrate AI and Machine Learning services such as Azure AI Services, Azure OpenAI, Azure Machine Learning, and Cognitive Services into enterprise applications.
• Create and maintain data models, transformations, and processing frameworks.
• Implement data governance, data quality, security, and compliance controls.
• Monitor and optimize data platform performance, scalability, and cost.
• Collaborate with Data Scientists, AI Engineers, Business Analysts, and Application Development teams.
• Develop reusable frameworks and automation for data orchestration and deployment.
• Support CI/CD implementation using Azure DevOps and Infrastructure as Code (IaC).
• Troubleshoot data-related issues and provide production support.

Conoscenze

Data engineering

Azure cloud

Python

SQL

Spark

Agile methodologies

AI/ML integration

Formazione

Bachelor’s or Master’s degree in CS/IT/Data Science

Strumenti

Azure Data Factory

Azure Databricks

Azure Synapse Analytics

Azure Data Lake

Azure OpenAI

Azure Machine Learning

Cognitive Services

Azure DevOps

Descrizione del lavoro

We are looking forward to hire Azure Databricks Professionals in the following areas :

Experience

1-4 Years

We are seeking an experienced Azure Databricks/ADF/AI Data Engineer with 3 to 6 years of hands-on experience in designing, developing, and maintaining scalable data and AI solutions on Microsoft Azure. The ideal candidate should possess strong expertise in data engineering, Azure cloud services, AI/ML integration, data pipelines, and modern analytics platforms to support business intelligence and AI-driven applications.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Azure services.
• Build and optimize ETL/ELT workflows for structured and unstructured data.
• Implement data ingestion solutions using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
• Develop and manage data lakes and data warehouse solutions on Azure.
• Integrate AI and Machine Learning services such as Azure AI Services, Azure OpenAI, Azure Machine Learning, and Cognitive Services into enterprise applications.
• Create and maintain data models, transformations, and processing frameworks.
• Implement data governance, data quality, security, and compliance controls.
• Monitor and optimize data platform performance, scalability, and cost.
• Collaborate with Data Scientists, AI Engineers, Business Analysts, and Application Development teams.
• Develop reusable frameworks and automation for data orchestration and deployment.
• Support CI/CD implementation using Azure DevOps and Infrastructure as Code (IaC).
• Troubleshoot data-related issues and provide production support.

Azure AI & Machine Learning

• Azure AI Services
• Azure OpenAI Service
• Azure Machine Learning
• Azure Cognitive Services
• Generative AI concepts and implementation

Required Qualifications

• Bachelors or Masters degree in Computer Science, Information Technology, Data Science, or related field.
• 3 to 6 years of experience in Data Engineering and Azure Cloud technologies.
• Strong experience with Azure Data Factory, Databricks, Synapse Analytics, and Data Lake.
• Experience working with large-scale structured and semi-structured datasets.
• Knowledge of AI/ML integration and Generative AI solutions on Azure.
• Hands-on experience with Python, SQL, and Spark.
• Strong understanding of cloud architecture, security, and performance optimization.
• Experience with Agile development methodologies.

Preferred Qualifications

• Microsoft Azure Certifications such as:
  • DP-203: Azure Data Engineer Associate
  • AI-102: Azure AI Engineer Associate
  • AZ-305: Azure Solutions Architect Expert
• Experience with Microsoft Fabric.
• Experience in Retrieval-Augmented Generation (RAG) architectures.
• Knowledge of Vector Databases and Semantic Search.
• Experience integrating Azure OpenAI with enterprise applications.

Our Hyperlearning workplace is grounded upon four principles

• Flexible work arrangements, Free spirit, and emotional positivity
• Agile self-determination, trust, transparency, and open collaboration
• All Support needed for the realization of business goals,
• Stable employment with a great atmosphere and ethical corporate culture

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.