Sr. Software Engineer - Databricks Job

YASH Technologies, Inc.; Pune District; On-site; INR 1,200,000 - 2,500,000; Full time

Job summary

YASH Technologies, Inc. is seeking Databricks professionals to design, develop, and maintain scalable data pipelines. You will build ELT/ETL workflows and data products for analytics, BI, and reporting, leveraging Databricks, dbt, Spark, Python, and SQL in a modern data platform.

Ideal candidates bring 4+ years as data engineers, strong SQL, experience with data warehousing, Power BI, and data governance. You will collaborate across teams to deliver trusted datasets and ensure quality and

Qualifications

• 4+ years of experience as a data engineer.
• Strong SQL skills for data analysis, transformation and modeling.
• Hands-on with scalable datapipelines using Python and Spark.
• Experience with Databricks for large-scale data processing.
• Experience using dbt for data transformation frameworks.
• Solid data warehousing concepts, Medallion Architecture, modern data platform design.
• Experience building trusted datasets and semantic models, incl. Power BI.
• Knowledge of data quality, metadata management, lineage and governance.
• Familiarity with source control, CI/CD, testing and automated deployment.
• Experience leveraging AI-assisted development tools; responsible AI practices.

Responsibilities

• Design, develop, and maintain scalable datapipelines from multiple sources.
• Build and support ELT/ETL workflows using AWS, Databricks, dbt, Spark, Python, and SQL.
• Develop reliable data products supporting reporting, analytics, BI initiatives.
• Implement data transformation and modeling aligned with Medallion Architecture.
• Collaborate with stakeholders to translate requirements into scalable solutions.
• Perform data profiling, validation, reconciliation, and quality monitoring.
• Prepare datasets for Power BI and other reporting tools.
• Analyze trends and identify opportunities to improve data quality and outcomes.
• Contribute to improving data engineering standards, governance, and best practices.
• Troubleshoot pipeline failures and performance bottlenecks with root-cause analysis.
• Partner with engineering to deliver scalable, compliant solutions.
• Stay updated with modern engineering practices and AI-enabled productivity tools.

Skills

SQL for data analysis

Python

Apache Spark

Databricks

dbt

Data warehousing

Power BI

Data governance

CI/CD

AI-assisted development

Responsible AI

Collaboration

Data quality

Job description

Select how often (in days) to receive an alert: Create Alert

YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation.

At YASH, we’re a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single truth – bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future.

We are looking forward to hireDatabricks Professionals in the following areas :

Experience required- 4 to 6

Responsibilities

• Design, develop, and maintain scalabledatapipelines to ingest, process, transform, and curatedatafrom multiple enterprise and eCommercedatasources.
• Build and support ELT/ETL workflows using AWS,Databricks, dbt, Spark, Python, and SQL.
• Develop and maintain reliable, reusable, and high-qualitydataproducts that support reporting,analytics, and business intelligence initiatives.
• Implementdatatransformation and modelling solutions aligned with Medallion Architecture principles.
• Collaborate with business stakeholders, analysts, and product teams to understand requirements and translate them into scalable technical solutions.
• Performdataprofiling, validation, reconciliation, and quality monitoring to ensure trusted businessdata.
• Support analytical and reporting solutions bydesigning and preparingdatasets for Power BI and other reporting tools.
• Analyzedatatrends and identify opportunities to improve operational performance,dataquality, and business outcomes.
• Contribute to the continuous improvement ofdataengineeringstandards, platform capabilities,datagovernance, and best practices.
• Troubleshoot pipeline failures, performance bottlenecks, anddataquality issues through root cause analysis and corrective actions.
• Partner withengineeringand business teams to deliver scalable solutions aligned to enterprise architecture, security, and governance standards.
• Continuously evaluate and adopt modernengineeringpractices and AI-enabled productivity capabilities to improve delivery efficiency and solution quality

Required Skills

• 4+ years of experience as aDataEngineer
• Strong proficiency in SQL fordataanalysis, transformation, optimization, anddatamodelling.
• Hands-on experience developing scalabledatapipelines using Python and Apache Spark.
• Experience working withDatabricks for large-scaledataprocessing andanalyticsengineering.
• Experience using dbt to develop, test, document, and deploydatatransformation frameworks.
• Strong understanding ofdatawarehousing concepts, dimensional modelling, Medallion Architecture, and moderndataplatformdesign.
• Experience building trusteddatasets and semantic models that support business intelligence and reporting solutions, including Power BI.
• Understanding ofdataquality, metadatamanagement, lineage, governance, and operational monitoring.
• Familiarity with source control, CI/CD practices, testing frameworks, and automated deployment processes.
• Hands-on experience leveraging AI-assisted development and productivity tools (such as Microsoft Copilot, Copilot CLI,Databricks Genie, and similar AI-powered assistants) to accelerate development ofdatapipelines,datamodels, analyticaldatasets, and reporting solutions while improving code quality, documentation, troubleshooting, and delivery efficiency.
• Understanding of responsible AI practices, including validation of AI-generated outputs,dataprivacy, security, and governance considerations.
• Strong analytical and problem-solving capabilities, with the ability to translate business requirements into scalable technical solutions.
• Effective collaboration and communication skills, with the ability to work across business,analytics, andengineeringteams in a global environment.
• Demonstrated ownership mindset with a strong focus on quality, continuous improvement, and delivering business value.

Desired Skills

• Experience working with eCommerce, digital commerce, customer journey, product catalogue, pricing, transaction, order management, or digital channeldata.
• Experiencedesigning cloud-nativedataproducts andanalyticssolutions at enterprise scale.
• Exposure to Scala for distributeddataprocessing workloads.
• Experience supporting advancedanalytics, machine learning, and AI-driven business solutions.
• Familiarity withdataobservability,dataquality frameworks, anddatagovernance platforms.
• Experience working within Agile product teams and modern software development methodologies.
• Knowledge of real-time, streaming, or event-driven data architectures.
• Experience working with AWS cloud services and cloud-native data engineering architectures.

At YASH, you are empowered to create a career that will take you to where you want to go while working in an inclusive team environment.We leverage career-oriented skilling models and optimize our collective intelligence aided with technology for continuous learning, unlearning, and relearning at a rapid pace and scale.

Our Hyperlearning workplace is grounded upon four principles

• Flexible work arrangements, Free spirit, and emotional positivity
• Agile self-determination, trust, transparency, and open collaboration
• All Support needed for the realization of business goals,
• Stable employment with a great atmosphere and ethical corporate culture