Databricks Data Engineer

NextGen Digital Solutions - NDS; Mumbai; On-site; INR 900,000 - 1,500,000; Full time

Job summary

NextGen Digital Solutions - NDS in Mumbai is seeking a Databricks Data Engineer with 1–3 years of hands-on experience to develop and maintain data pipelines. You will work with senior engineers to transform data and build reliable data solutions on the Databricks Lakehouse platform.

The role requires strong PySpark and SQL skills, familiarity with Delta Lake and Lakehouse architecture, and experience delivering ETL/ELT pipelines with data cleansing and validation.

Qualifications

• Hands-on experience with Databricks and data engineering.
• Strong PySpark and SQL fundamentals for building pipelines.
• Knowledge of Delta Lake and Lakehouse architecture.
• Experience with ETL/ELT processes and data cleansing.
• Ability to work with senior data engineers.

Responsibilities

• Develop and maintain data pipelines using Databricks.
• Build data transformation processes with PySpark and SQL.
• Work with Delta Lake to manage data tables.
• Implement data processing across Bronze, Silver and Gold layers.
• Extract and transform data from multiple data sources.
• Develop ETL/ELT pipelines according to project requirements.
• Perform data cleansing, transformation and validation.
• Write optimized SQL queries for data processing and analysis.
• Monitor and troubleshoot data pipelines and jobs.
• Identify and resolve data quality and pipeline-related issues.
• Work with senior Data Engineers and Data Modellers to implement data models.
• Assist in designing and maintaining scalable Lakehouse solutions.
• Participate in testing, debugging and performance optimization.
• Maintain technical documentation for data pipelines and processes.
• Follow development, version control and deployment standards.

Skills

Databricks

PySpark

SQL

Delta Lake

Lakehouse

ETL/ELT concepts

Data cleansing

Data processing

Analytical thinking

Collaboration

Job description

Job Title: Databricks Data Engineer

Location: Mumbai

Experience: 1–3 Years

Employment Type: Full-time

Role Overview

We are looking for a Databricks Data Engineer with 1–3 years of hands-on experience in data engineering and Databricks. The ideal candidate should have good knowledge of Databricks, PySpark, SQL, Delta Lake and ETL/ELT processes.

The candidate will work with senior data engineers and technical teams to develop data pipelines, transform data and build reliable data solutions using the Databricks Lakehouse platform.

Key Responsibilities

• Develop and maintain data pipelines using Databricks.
• Build data transformation processes using PySpark and SQL.
• Work with Delta Lake to create and maintain reliable data tables.
• Implement data processing across Bronze, Silver and Gold layers.
• Extract and transform data from multiple data sources.
• Develop ETL/ELT pipelines according to project requirements.
• Perform data cleansing, transformation and validation.
• Write optimized SQL queries for data processing and analysis.
• Monitor and troubleshoot data pipelines and jobs.
• Identify and resolve data quality and pipeline-related issues.
• Work with senior Data Engineers and Data Modellers to implement data models.
• Assist in designing and maintaining scalable Lakehouse solutions.
• Participate in testing, debugging and performance optimization.
• Maintain technical documentation for data pipelines and processes.
• Follow development, version control and deployment standards.

Required Skills & Qualifications

• 1–3 years of experience in Data Engineering / ETL / Data Processing.
• Hands-on experience with Databricks.
• Good knowledge of PySpark.
• Strong SQL fundamentals.
• Understanding of Delta Lake.
• Understanding of Lakehouse architecture.
• Good understanding of ETL/ELT concepts.
• Experience working with data transformation and data cleansing.
• Basic understanding of data warehousing concepts.
• Good analytical and problem-solving skills.
• Ability to work collaboratively with senior technical teams.
• Skills: etl,data processing,lake