Module Lead - Azure Databricks Job

YASH Technologies; Pune District; On-site; INR 900,000 - 1,400,000; Full time

Job summary

YASH Technologies is seeking a Data Engineer with 5-8 years of experience to develop and maintain data lakes and BI solutions. The role requires strong SQL and Python skills, plus experience with Azure Databricks, Spark, and Power BI dashboards.

Location preferred Gurgaon; collaboration with business and tech teams is essential to deliver scalable, end-to-end data solutions and drive strategic insights.

Qualifications

• Experience with data modelling, SQL, ETL, data warehousing and data lakes.
• Experience writing SQL and Python scripts.
• Experience building dashboards and reports using Power BI.
• Experience with Azure Databricks and Spark.
• Knowledge of NoSQL databases like Cosmos DB or MongoDB.
• Experience following Agile processes and Git.
• Experience with Mulesoft/Kingswaysoft/Marketo.

Responsibilities

• Develop, implement, and maintain the data lake and insight platforms for decision support.
• Aggregate data sets to answer business questions and design ETLs for data warehouse and lake.
• Collaborate with business users and development teams to define requirements and deliver end-to-end solutions.
• Build BI solutions including dashboards and reporting using Power BI.
• Define data ownership SLA and ensure data quality across platforms.
• Apply data modelling, metadata, and data governance best practices.

Skills

SQL

Python

Power BI

Azure Databricks

Spark

ETL

Data Warehousing

Data Lakes

NoSQL

Tools

Azure Data Factory

Git

Cosmos DB

MongoDB

Mulesoft

Job description

Job Description:

YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation.

At YASH, we’re a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single truth – bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future.

We are looking forward to hireAzure Databricks Professionals in the following areas :

Experience

5-8 Years

Job Description

Data Engineer
Experience: 5-8 Years

Location: Preferred Gurgaon.

Responsibilities:

• Develop, implement, and maintain the information data lake and using insight platforms to enable decision support systems for the overall organization. Partner with the business and our customers to understand their data and reporting requirements.
• Bring data sets together to answer business questions and drive growth. Design ETLs to ingest the data into the data warehouse and data lake, as well as end-user facing reporting applications.
• Collaborate with business customers and development teams to define requirements and deliver flexible, scalable, end-to-end solutions.
• Work with new technologies while driving business intelligence solutions end-to-end: business requirements, data modelling, ETL, metadata, reporting, and dashboarding.
• Apply expertise in the design, creation, management, and business use of large datasets.
• Defines SLA for all areas of ownership.
• Experience with Data modelling, SQL, ETL, Data Warehousing and Data lakes
• Experience in writing SQL and Python scripts
• Experience in building dashboards and report using Microsoft Power BI.

Preferred Qualifications:

• Experience in transforming data using Azure data factory
• Experience working with Spark and Azure Databricks
• Ability to balance and prioritize multiple conflicting requirements with high attention to detail.
• Strong verbal/written communication & data presentation skills, including ability to succinctly summarize key findings and effectively communicate with both business and technical teams.
• Familiarity of scripting language such as Python, PySpark, or JavaScript
• Knowledge of Azure Databricks and MPP databases
• Experience with Data Lake development
• Exposure to NoSQL databases (such as Cosmos DB, MongoDB)
• Experience working on Microsoft Power BI dashboards.
• Experience following the Agile processes.
• Experience working with distributed version control system like Git.
• Experience with Mulesoft/Kingswaysoft/Marketo.

Required Technical/ Functional Competencies

Domain/ Industry Knowledge:

• Basic knowledge of customers business processes- relevant technology platform or product.
• Able to prepare process maps, workflows, business cases and simple business models in line with customer requirements with assistance from SME and apply industry standards/ practices in implementation with guidance from experienced team members.

Requirement Gathering and Analysis:

• Working knowledge of requirement management processes and requirement analysis processes, tools & methodologies.
• Able to analyse the impact of change requested/ enhancement/ defect fix and identify dependencies or interrelationships among requirements & transition requirements for engagement.

Product/ Technology Knowledge:

• Working knowledge of technology product/platform standards and specifications.
• Able to implement code or configure/customize products and provide inputs in design and architecture adhering to industry standards/ practices in implementation.
• Analyze various frameworks/tools, review the code and provide feedback on improvement opportunities.

Architecture tools and frameworks:

• Working knowledge of architecture Industry tools & frameworks.
• Able to identify pros/ cons of available tools & frameworks in market and use those as per Customer requirement and explore new tools/ framework for implementation.

Architecture concepts and principles

• Working knowledge of architectural elements, SDLC, methodologies.
• Able to provides architectural design/ documentation at an application or function capability level and implement architectural patterns in solution & engagements and communicates architecture direction to the business.

Analytics Solution Design:

• Knowledge of statistical & machine learning techniques like classification, linear regression modelling, clustering & decision trees.
• Able to identify the cause of errors and their potential solutions.

Tools & Platform Knowledge:

• Familiar with wide range of mainstream commercial & open-source data science/analytics software tools, their constraints, advantages, disadvantages, and areas of application.

Required Behavioral Competencies

Accountability:

• Takes responsibility for and ensures accuracy of own work, as well as the work and deadlines of the team.

Collaboration:

• Shares information within team, participates in team activities, asks questions to understand other points of view.

Agility:

• Demonstrates readiness for change, asking questions and determining how changes could impact own work.

Customer Focus:

• Identifies trends and patterns emerging from customer preferences and works towards customizing/ refining existing services to exceed customer needs and expectations.

Communication:

• Targets communications for the appropriate audience, clearly articulating and presenting his/her position or decision.

Drives Results:

• Sets realistic stretch goals for self & others to achieve and exceed defined goals/targets.

Resolves Conflict:

• Displays sensitivity in interactions and strives to understand others’ views and concerns.

At YASH, you are empowered to create a career that will take you to where you want to go while working in an inclusive team environment.We leverage career-oriented skilling models and optimize our collective intelligence aided with technology for continuous learning, unlearning, and relearning at a rapid pace and scale.

Our Hyperlearning workplace is grounded upon four principles

• Flexible work arrangements, Free spirit, and emotional positivity
• Agile self-determination, trust, transparency, and open collaboration
• All Support needed for the realization of business goals,
• Stable employment with a great atmosphere and ethical corporate culture